2024-04-26T02:09:37.492 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T02:09:37.492 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} --name yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287 --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/orig.config.yaml 2024-04-26T02:09:37.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T02:09:37.621 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287 branch: wip-yuri2-testing-2024-04-24-0914-squid description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} email: yweinste@redhat.com first_in_suite: false job_id: '7674287' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri2-testing-2024-04-24-0914-squid ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 2500 ms tcp read timeout: 5 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.1 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - slow request - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: ddeaa91797339a19172c3036ff48cca58c12f448 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: ddeaa91797339a19172c3036ff48cca58c12f448 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2024-04-24-0914-squid sha1: ddeaa91797339a19172c3036ff48cca58c12f448 owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 1848 sha1: ddeaa91797339a19172c3036ff48cca58c12f448 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri2-testing-2024-04-24-0914-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ddeaa91797339a19172c3036ff48cca58c12f448/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ddeaa91797339a19172c3036ff48cca58c12f448 targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSsQGKQvhqYS2w3S+QMQHzTXmOuby59U4v80ULUXSEe3VlZIXjn0DnApzJ5Z3iwd2QLxlwyne3k3Q3q6hlifUc= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMP6+e7e/LOM9jybaRjlOKrFC03d418pRbBFqcfN6YVLe++zo1vYxjkMpGyq3hX6akzerpG3WQck+uQgH8Rd2xE= smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDDdarR2RZ6hFOHsedtJBTWBBBdGTvZNAJkb9YaVx35Zb4mOX0PxS0zRlvGUwJOzlBdkVUc7JCz+5IepVMoFPSE= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlpZWcgP7DwBGkkokV/DqahLDEpq1ngMsV1NQu6//QNR4z0gqY386my9L7XkGWOKucsu5AF/EtKy+G2ZkziBus= tasks: - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: bluestore_new_sharding: random chance_bluestore_reshard: 1 chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 min_in: 8 timeout: 1200 - rados: clients: - client.0 ec_pool: true erasure_code_profile: c: 2 crush-failure-domain: osd k: 4 m: 3 name: shecprofile plugin: shec objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 400 write_append_excl: false teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_01:23:56 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T02:09:37.621 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ddeaa91797339a19172c3036ff48cca58c12f448/qa; will attempt to use it 2024-04-26T02:09:37.622 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ddeaa91797339a19172c3036ff48cca58c12f448/qa/tasks 2024-04-26T02:09:37.622 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T02:09:37.624 INFO:teuthology.task.internal:Checking packages... 2024-04-26T02:09:37.645 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ddeaa91797339a19172c3036ff48cca58c12f448' 2024-04-26T02:09:37.645 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T02:09:37.645 INFO:teuthology.packaging:ref: None 2024-04-26T02:09:37.646 INFO:teuthology.packaging:tag: None 2024-04-26T02:09:37.646 INFO:teuthology.packaging:branch: wip-yuri2-testing-2024-04-24-0914-squid 2024-04-26T02:09:37.646 INFO:teuthology.packaging:sha1: ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:09:37.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri2-testing-2024-04-24-0914-squid 2024-04-26T02:09:37.785 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:09:37.787 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T02:09:37.795 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T02:09:37.795 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T02:09:37.807 INFO:teuthology.task.internal:Saving configuration 2024-04-26T02:09:37.822 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T02:09:37.828 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T02:09:37.853 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 02:03:58.369146', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICjEHLtXuW3Mt8Doa3oAZoS0vqQQ6ZZ6FHVwZlE8eFRJ'} 2024-04-26T02:09:37.876 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 02:03:58.370487', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKMFcRX8KxufSrettZhu8n/oOkb8/+1RcL+BCjrRD02G'} 2024-04-26T02:09:37.901 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 02:03:58.371605', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBOZrYxDhFeQ10mW7Ffteg7CAbyvkCNWoUrQGtjbbfuC'} 2024-04-26T02:09:37.925 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 02:03:58.372725', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILYfTIGm+yq8MjgX6negmdHrgYv6jruu5qGjHFK/S/9W'} 2024-04-26T02:09:37.925 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T02:09:37.934 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2024-04-26T02:09:37.934 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2024-04-26T02:09:37.934 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2024-04-26T02:09:37.934 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2024-04-26T02:09:37.934 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T02:09:38.087 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f58b6bdc3a0>, signals=[15]) 2024-04-26T02:09:38.088 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T02:09:38.094 INFO:teuthology.task.internal:Opening connections... 2024-04-26T02:09:38.094 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:09:38.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:09:38.177 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:09:38.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:09:38.256 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:09:38.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:09:38.333 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:09:38.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:09:38.413 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T02:09:38.423 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-04-26T02:09:38.429 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-04-26T02:09:38.429 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="22.04" 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=jammy 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T02:09:38.478 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T02:09:38.479 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=jammy 2024-04-26T02:09:38.479 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-26T02:09:38.507 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-04-26T02:09:38.513 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-04-26T02:09:38.513 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-26T02:09:38.560 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T02:09:38.560 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2024-04-26T02:09:38.560 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04" 2024-04-26T02:09:38.560 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T02:09:38.560 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy 2024-04-26T02:09:38.561 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2024-04-26T02:09:38.561 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2024-04-26T02:09:38.561 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T02:09:38.561 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T02:09:38.561 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T02:09:38.561 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T02:09:38.561 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy 2024-04-26T02:09:38.561 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-26T02:09:38.582 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-26T02:09:38.588 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-26T02:09:38.588 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu" 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04" 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T02:09:38.635 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T02:09:38.636 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T02:09:38.636 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T02:09:38.636 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy 2024-04-26T02:09:38.636 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-26T02:09:38.657 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-26T02:09:38.663 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-26T02:09:38.663 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Ubuntu" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="22.04" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_CODENAME=jammy 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:ID=ubuntu 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE=debian 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T02:09:38.709 INFO:teuthology.orchestra.run.smithi175.stdout:UBUNTU_CODENAME=jammy 2024-04-26T02:09:38.710 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-26T02:09:38.732 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T02:09:38.747 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T02:09:38.757 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T02:09:38.758 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-04-26T02:09:38.760 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-04-26T02:09:38.762 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-04-26T02:09:38.765 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-26T02:09:38.769 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T02:09:38.779 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T02:09:38.779 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-04-26T02:09:38.807 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-04-26T02:09:38.809 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-04-26T02:09:38.812 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-26T02:09:38.915 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T02:09:39.021 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T02:09:39.039 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T02:09:39.039 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T02:09:39.039 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T02:09:39.039 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T02:09:39.040 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T02:09:39.040 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T02:09:39.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:09:39.045 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-26T02:09:39.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:09:39.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:09:39.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:09:39.047 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-26T02:09:39.047 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-04-26T02:09:39.047 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-26T02:09:39.095 INFO:teuthology.orchestra.run.smithi142.stdout:5.15.0-56-generic 2024-04-26T02:09:39.095 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.15.0-56-generic 2024-04-26T02:09:39.095 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2024-04-26T02:09:39.097 INFO:teuthology.orchestra.run.smithi059.stdout:5.15.0-56-generic 2024-04-26T02:09:39.097 INFO:teuthology.orchestra.run.smithi136.stdout:5.15.0-56-generic 2024-04-26T02:09:39.098 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-56-generic 2024-04-26T02:09:39.098 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.15.0-56-generic 2024-04-26T02:09:39.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get clean 2024-04-26T02:09:39.098 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.15.0-56-generic 2024-04-26T02:09:39.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2024-04-26T02:09:39.099 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.15.0-56-generic 2024-04-26T02:09:39.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-04-26T02:09:39.213 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-26T02:09:39.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-04-26T02:09:39.230 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-04-26T02:09:39.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2024-04-26T02:09:39.420 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T02:09:39.453 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:09:39.459 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:09:39.487 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T02:09:39.492 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T02:09:39.505 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T02:09:39.507 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T02:09:39.507 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-26T02:09:39.535 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:09:39.536 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:09:39.601 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T02:09:39.604 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-26T02:09:39.657 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T02:09:39.657 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T02:09:39.691 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T02:09:39.726 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T02:09:39.768 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T02:09:39.806 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T02:09:39.847 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T02:09:39.850 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T02:09:39.850 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T02:09:39.850 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T02:09:39.869 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T02:09:39.870 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T02:09:39.876 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:39.876 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T02:09:39.879 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T02:09:39.882 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T02:09:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T02:09:39.886 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T02:09:39.888 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T02:09:39.895 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T02:09:39.902 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T02:09:39.906 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T02:09:39.910 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T02:09:39.911 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T02:09:39.911 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T02:09:39.912 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T02:09:39.913 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-26T02:09:39.913 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T02:09:39.914 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T02:09:39.939 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T02:09:39.944 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:39.944 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T02:09:39.946 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T02:09:39.946 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T02:09:39.947 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T02:09:39.947 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T02:09:39.953 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T02:09:39.954 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T02:09:39.955 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T02:09:39.956 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T02:09:39.956 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T02:09:39.956 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T02:09:39.967 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T02:09:39.976 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T02:09:39.976 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T02:09:39.982 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:39.982 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T02:09:39.983 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T02:09:39.985 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T02:09:39.985 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T02:09:39.986 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T02:09:39.986 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T02:09:39.987 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T02:09:39.988 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T02:09:39.991 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T02:09:39.993 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T02:09:40.008 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T02:09:40.012 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T02:09:40.012 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T02:09:40.013 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T02:09:40.014 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T02:09:40.014 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T02:09:40.023 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T02:09:40.024 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T02:09:40.025 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T02:09:40.032 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-26T02:09:40.044 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T02:09:40.044 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T02:09:40.045 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T02:09:40.045 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T02:09:40.046 INFO:teuthology.orchestra.run.smithi059.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T02:09:40.093 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T02:09:40.196 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T02:09:40.203 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T02:09:40.206 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-26T02:09:40.294 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T02:09:40.364 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T02:09:40.372 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T02:09:40.375 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-26T02:09:40.377 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T02:09:40.377 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T02:09:40.384 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T02:09:40.385 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T02:09:40.390 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-26T02:09:40.390 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-26T02:09:40.443 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T02:09:40.458 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T02:09:40.459 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T02:09:40.460 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T02:09:40.460 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T02:09:40.461 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T02:09:40.469 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:40.469 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T02:09:40.471 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T02:09:40.472 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T02:09:40.485 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T02:09:40.488 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:40.488 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T02:09:40.489 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-26T02:09:40.490 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-26T02:09:40.490 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-26T02:09:40.496 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:40.496 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T02:09:40.500 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-26T02:09:40.511 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-26T02:09:40.522 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T02:09:40.529 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:40.669 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T02:09:40.681 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T02:09:40.689 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-26T02:09:40.693 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T02:09:41.074 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T02:09:41.078 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T02:09:41.079 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T02:09:41.084 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T02:09:41.090 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-26T02:09:41.093 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T02:09:41.094 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T02:09:41.096 INFO:teuthology.orchestra.run.smithi142.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T02:09:41.097 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T02:09:41.097 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-26T02:09:41.100 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-26T02:09:41.101 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T02:09:41.103 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T02:09:41.111 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-26T02:09:41.114 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-26T02:09:41.268 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T02:09:41.380 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T02:09:41.400 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T02:09:41.401 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T02:09:41.404 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T02:09:41.405 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T02:09:41.406 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T02:09:41.406 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T02:09:41.409 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T02:09:41.414 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T02:09:41.579 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T02:09:41.662 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T02:09:41.743 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T02:09:41.824 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T02:09:41.856 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T02:09:42.174 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-26T02:09:45.438 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 13.2 MB in 2s (6,901 kB/s) 2024-04-26T02:09:45.925 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 13.2 MB in 2s (6,411 kB/s) 2024-04-26T02:09:45.980 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-26T02:09:46.198 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 13.2 MB in 3s (5,168 kB/s) 2024-04-26T02:09:46.586 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-26T02:09:46.606 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-26T02:09:46.651 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-26T02:09:46.868 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-26T02:09:46.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:09:46.942 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-26T02:09:47.140 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2024-04-26T02:09:47.140 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2024-04-26T02:09:47.295 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:09:47.295 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:09:47.295 INFO:teuthology.orchestra.run.smithi142.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:09:47.296 INFO:teuthology.orchestra.run.smithi142.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:09:47.296 INFO:teuthology.orchestra.run.smithi142.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T02:09:47.296 INFO:teuthology.orchestra.run.smithi142.stdout: python2.7-minimal 2024-04-26T02:09:47.296 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:09:47.297 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2024-04-26T02:09:47.297 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:09:47.297 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T02:09:47.297 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T02:09:47.298 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2024-04-26T02:09:47.299 INFO:teuthology.orchestra.run.smithi142.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T02:09:47.299 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2024-04-26T02:09:47.299 INFO:teuthology.orchestra.run.smithi142.stdout: thermald 2024-04-26T02:09:47.350 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-26T02:09:47.352 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2024-04-26T02:09:47.352 INFO:teuthology.orchestra.run.smithi142.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:09:47.353 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T02:09:47.353 INFO:teuthology.orchestra.run.smithi142.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T02:09:47.354 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages will be upgraded: 2024-04-26T02:09:47.355 INFO:teuthology.orchestra.run.smithi142.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T02:09:47.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:09:47.412 INFO:teuthology.orchestra.run.smithi142.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:09:47.412 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 113 MB of archives. 2024-04-26T02:09:47.412 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T02:09:47.412 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T02:09:47.475 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-26T02:09:47.491 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-26T02:09:47.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:09:47.558 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-26T02:09:47.677 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-04-26T02:09:47.678 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-04-26T02:09:47.736 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-04-26T02:09:47.736 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-04-26T02:09:47.859 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:09:47.859 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:09:47.859 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:09:47.859 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:09:47.860 INFO:teuthology.orchestra.run.smithi059.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T02:09:47.860 INFO:teuthology.orchestra.run.smithi059.stdout: python2.7-minimal 2024-04-26T02:09:47.860 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:09:47.861 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-04-26T02:09:47.861 INFO:teuthology.orchestra.run.smithi059.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:09:47.861 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T02:09:47.862 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T02:09:47.863 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-04-26T02:09:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T02:09:47.863 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2024-04-26T02:09:47.863 INFO:teuthology.orchestra.run.smithi059.stdout: thermald 2024-04-26T02:09:47.869 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T02:09:47.893 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:09:47.893 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:09:47.893 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:09:47.893 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:09:47.893 INFO:teuthology.orchestra.run.smithi136.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T02:09:47.894 INFO:teuthology.orchestra.run.smithi136.stdout: python2.7-minimal 2024-04-26T02:09:47.894 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:09:47.895 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2024-04-26T02:09:47.895 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:09:47.895 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T02:09:47.895 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T02:09:47.896 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2024-04-26T02:09:47.896 INFO:teuthology.orchestra.run.smithi136.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T02:09:47.896 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2024-04-26T02:09:47.896 INFO:teuthology.orchestra.run.smithi136.stdout: thermald 2024-04-26T02:09:47.911 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-04-26T02:09:47.911 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:09:47.911 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T02:09:47.912 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T02:09:47.913 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages will be upgraded: 2024-04-26T02:09:47.914 INFO:teuthology.orchestra.run.smithi059.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T02:09:47.943 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2024-04-26T02:09:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:09:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T02:09:47.943 INFO:teuthology.orchestra.run.smithi136.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T02:09:47.945 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages will be upgraded: 2024-04-26T02:09:47.945 INFO:teuthology.orchestra.run.smithi136.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T02:09:47.983 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T02:09:47.986 INFO:teuthology.orchestra.run.smithi059.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:09:47.986 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 113 MB of archives. 2024-04-26T02:09:47.986 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T02:09:47.986 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T02:09:48.126 INFO:teuthology.orchestra.run.smithi136.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:09:48.126 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 113 MB of archives. 2024-04-26T02:09:48.126 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T02:09:48.126 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T02:09:48.728 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T02:09:48.937 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T02:09:49.216 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T02:09:49.216 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T02:09:49.217 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T02:09:49.440 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T02:09:49.493 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T02:09:49.693 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T02:09:49.922 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 113 MB in 2s (53.1 MB/s) 2024-04-26T02:09:49.970 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T02:09:49.971 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T02:09:49.971 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T02:09:50.093 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T02:09:50.102 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T02:09:50.121 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T02:09:50.161 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T02:09:50.580 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 113 MB in 2s (50.6 MB/s) 2024-04-26T02:09:50.811 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-26T02:09:50.982 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T02:09:51.423 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-26T02:09:51.595 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-26T02:09:52.068 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T02:09:52.072 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:52.273 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:52.278 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T02:09:52.278 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T02:09:52.279 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T02:09:52.643 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T02:09:52.724 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T02:09:52.933 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T02:09:52.937 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:52.953 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-26T02:09:53.022 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:53.114 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 113 MB in 5s (23.7 MB/s) 2024-04-26T02:09:53.288 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T02:09:54.356 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T02:09:54.377 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:54.444 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:54.926 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T02:09:54.946 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:54.984 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:55.255 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T02:09:55.260 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:55.320 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:55.338 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-26T02:09:55.354 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T02:09:55.376 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:55.463 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:55.899 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T02:09:55.920 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:55.949 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:55.991 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-26T02:09:56.075 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-26T02:09:56.092 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-26T02:09:56.217 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-26T02:09:56.256 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-26T02:09:56.257 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-26T02:09:56.359 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-26T02:09:56.493 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-26T02:09:56.688 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-26T02:09:56.770 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-26T02:09:56.852 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-26T02:09:56.907 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-26T02:09:56.960 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-26T02:09:57.831 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T02:09:57.852 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:57.924 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:09:58.343 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T02:09:58.363 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:09:58.401 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:01.365 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 13.2 MB in 18s (749 kB/s) 2024-04-26T02:10:01.587 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:01.689 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:01.972 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:02.092 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:02.115 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:02.218 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:02.412 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T02:10:02.434 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T02:10:02.478 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:02.541 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:02.686 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:02.745 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T02:10:02.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:10:02.813 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T02:10:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-26T02:10:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-26T02:10:02.997 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T02:10:03.020 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T02:10:03.055 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:03.146 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:10:03.146 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:10:03.146 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:10:03.147 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:10:03.147 INFO:teuthology.orchestra.run.smithi175.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-26T02:10:03.147 INFO:teuthology.orchestra.run.smithi175.stdout: python2.7-minimal 2024-04-26T02:10:03.147 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:10:03.148 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-26T02:10:03.148 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:10:03.148 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-26T02:10:03.149 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-26T02:10:03.150 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-26T02:10:03.150 INFO:teuthology.orchestra.run.smithi175.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-26T02:10:03.150 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-04-26T02:10:03.150 INFO:teuthology.orchestra.run.smithi175.stdout: thermald 2024-04-26T02:10:03.196 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-26T02:10:03.196 INFO:teuthology.orchestra.run.smithi175.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-26T02:10:03.196 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-26T02:10:03.197 INFO:teuthology.orchestra.run.smithi175.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-26T02:10:03.198 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-04-26T02:10:03.199 INFO:teuthology.orchestra.run.smithi175.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T02:10:03.566 INFO:teuthology.orchestra.run.smithi175.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:10:03.566 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 113 MB of archives. 2024-04-26T02:10:03.566 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-26T02:10:03.566 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-26T02:10:04.831 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:04.956 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:04.975 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-26T02:10:05.289 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:05.301 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-26T02:10:05.402 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:05.713 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T02:10:05.736 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T02:10:05.780 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:07.484 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-26T02:10:07.484 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-26T02:10:07.485 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-26T02:10:07.782 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T02:10:07.819 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:10:07.857 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:08.035 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-26T02:10:08.132 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-26T02:10:08.446 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T02:10:08.485 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:10:08.529 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:08.531 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 113 MB in 5s (23.0 MB/s) 2024-04-26T02:10:08.698 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-26T02:10:10.599 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-26T02:10:10.599 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:10.603 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:10:10.670 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:10.724 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:11.048 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:11.178 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:11.279 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T02:10:11.382 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:11.806 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:11.887 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T02:10:11.906 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:10:11.945 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:11.955 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:12.282 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:12.385 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:12.494 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T02:10:12.622 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:12.705 INFO:teuthology.orchestra.run.smithi142.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:12.706 INFO:teuthology.orchestra.run.smithi142.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:12.706 INFO:teuthology.orchestra.run.smithi142.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:12.706 INFO:teuthology.orchestra.run.smithi142.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:12.875 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:13.020 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-26T02:10:13.041 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:10:13.119 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:13.598 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-26T02:10:13.618 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:10:13.664 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:13.963 INFO:teuthology.orchestra.run.smithi059.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:13.963 INFO:teuthology.orchestra.run.smithi059.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:13.963 INFO:teuthology.orchestra.run.smithi059.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:13.963 INFO:teuthology.orchestra.run.smithi059.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:14.115 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:14.285 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:14.561 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:14.887 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:15.751 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:15.769 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T02:10:15.810 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:15.895 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T02:10:15.915 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:15.996 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:16.016 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T02:10:16.052 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T02:10:16.052 INFO:teuthology.orchestra.run.smithi142.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:16.127 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:17.151 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T02:10:17.252 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T02:10:17.379 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:17.445 INFO:teuthology.orchestra.run.smithi059.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T02:10:17.445 INFO:teuthology.orchestra.run.smithi059.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:17.453 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:17.453 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:17.453 INFO:teuthology.orchestra.run.smithi136.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:17.453 INFO:teuthology.orchestra.run.smithi136.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:17.605 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:18.993 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:19.916 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:20.132 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:20.369 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T02:10:20.431 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:20.494 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T02:10:20.527 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:20.822 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-26T02:10:20.845 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-26T02:10:20.888 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:21.379 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:21.433 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T02:10:21.433 INFO:teuthology.orchestra.run.smithi136.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:26.580 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-26T02:10:26.617 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-26T02:10:26.655 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:29.209 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-26T02:10:29.334 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-26T02:10:29.659 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-26T02:10:29.780 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:29.906 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-26T02:10:30.010 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:30.922 INFO:teuthology.orchestra.run.smithi142.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T02:10:30.922 INFO:teuthology.orchestra.run.smithi142.stdout:Sourcing file `/etc/default/grub' 2024-04-26T02:10:30.932 INFO:teuthology.orchestra.run.smithi142.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:30.955 INFO:teuthology.orchestra.run.smithi142.stdout:Generating grub configuration file ... 2024-04-26T02:10:31.235 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:31.248 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:31.285 INFO:teuthology.orchestra.run.smithi175.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:31.285 INFO:teuthology.orchestra.run.smithi175.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:31.285 INFO:teuthology.orchestra.run.smithi175.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:31.285 INFO:teuthology.orchestra.run.smithi175.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:31.437 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:31.525 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:31.530 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:31.595 INFO:teuthology.orchestra.run.smithi142.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:31.600 INFO:teuthology.orchestra.run.smithi142.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:31.772 INFO:teuthology.orchestra.run.smithi142.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:31.772 INFO:teuthology.orchestra.run.smithi142.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:31.772 INFO:teuthology.orchestra.run.smithi142.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:31.812 INFO:teuthology.orchestra.run.smithi142.stdout:done 2024-04-26T02:10:31.972 INFO:teuthology.orchestra.run.smithi059.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T02:10:31.972 INFO:teuthology.orchestra.run.smithi059.stdout:Sourcing file `/etc/default/grub' 2024-04-26T02:10:31.996 INFO:teuthology.orchestra.run.smithi059.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:32.018 INFO:teuthology.orchestra.run.smithi059.stdout:Generating grub configuration file ... 2024-04-26T02:10:32.226 DEBUG:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2024-04-26T02:10:32.284 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:32.286 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2024-04-26T02:10:32.286 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 21 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:32.287 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2024-04-26T02:10:32.288 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T02:10:32.288 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T02:10:32.288 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T02:10:32.288 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-04-26T02:10:32.288 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T02:10:32.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get clean 2024-04-26T02:10:32.306 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:32.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2024-04-26T02:10:32.598 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:32.605 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:32.612 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:10:32.612 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:10:32.612 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:10:32.630 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:10:32.678 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:32.684 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:32.823 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:32.867 INFO:teuthology.orchestra.run.smithi059.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:32.867 INFO:teuthology.orchestra.run.smithi059.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:32.867 INFO:teuthology.orchestra.run.smithi059.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:32.910 INFO:teuthology.orchestra.run.smithi059.stdout:done 2024-04-26T02:10:33.380 DEBUG:teuthology.orchestra.run.smithi059:> dpkg -s linux-image-generic 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Package: linux-image-generic 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Status: install ok installed 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Priority: optional 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Section: kernel 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Installed-Size: 21 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: amd64 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Source: linux-meta 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:33.401 INFO:teuthology.orchestra.run.smithi059.stdout:Recommends: thermald 2024-04-26T02:10:33.402 INFO:teuthology.orchestra.run.smithi059.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:33.402 INFO:teuthology.orchestra.run.smithi059.stdout: available. 2024-04-26T02:10:33.402 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T02:10:33.402 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T02:10:33.402 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T02:10:33.402 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T02:10:33.402 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T02:10:33.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get clean 2024-04-26T02:10:33.583 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-04-26T02:10:33.723 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:10:33.732 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:10:33.753 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:10:33.823 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:10:33.986 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-26T02:10:34.004 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:10:34.056 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-26T02:10:34.232 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-26T02:10:34.239 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2024-04-26T02:10:34.241 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2024-04-26T02:10:34.349 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-26T02:10:34.400 INFO:teuthology.orchestra.run.smithi142.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T02:10:34.400 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:10:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:10:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:10:34.400 INFO:teuthology.orchestra.run.smithi142.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:10:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:10:34.401 INFO:teuthology.orchestra.run.smithi142.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:10:34.401 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:10:34.439 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:10:34.441 DEBUG:teuthology.orchestra.run.smithi142:> dpkg -s linux-image-generic 2024-04-26T02:10:34.476 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Package: linux-image-generic 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Status: install ok installed 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Priority: optional 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Section: kernel 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Installed-Size: 21 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: amd64 2024-04-26T02:10:34.497 INFO:teuthology.orchestra.run.smithi142.stdout:Source: linux-meta 2024-04-26T02:10:34.498 INFO:teuthology.orchestra.run.smithi142.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:34.498 INFO:teuthology.orchestra.run.smithi142.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:34.498 INFO:teuthology.orchestra.run.smithi142.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:34.498 INFO:teuthology.orchestra.run.smithi142.stdout:Recommends: thermald 2024-04-26T02:10:34.498 INFO:teuthology.orchestra.run.smithi142.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:34.498 INFO:teuthology.orchestra.run.smithi142.stdout: available. 2024-04-26T02:10:34.498 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-26T02:10:34.541 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T02:10:34.542 INFO:teuthology.orchestra.run.smithi175.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:34.543 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.lDdKCRTZdT 2024-04-26T02:10:34.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub/grub.cfg /tmp/tmp.lDdKCRTZdT 2024-04-26T02:10:34.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.lDdKCRTZdT 2024-04-26T02:10:34.734 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.lDdKCRTZdT is 10KB 2024-04-26T02:10:34.747 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.lDdKCRTZdT 2024-04-26T02:10:34.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:34.805 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:10:34.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T02:10:34.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:34.869 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T02:10:34.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo update-grub 2024-04-26T02:10:35.102 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-26T02:10:35.120 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:10:35.185 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-26T02:10:35.328 INFO:teuthology.orchestra.run.smithi136.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T02:10:35.328 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub' 2024-04-26T02:10:35.337 INFO:teuthology.orchestra.run.smithi136.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:35.360 INFO:teuthology.orchestra.run.smithi136.stdout:Generating grub configuration file ... 2024-04-26T02:10:35.385 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-04-26T02:10:35.386 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-04-26T02:10:35.568 INFO:teuthology.orchestra.run.smithi059.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T02:10:35.568 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:10:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:10:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:10:35.568 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:10:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:10:35.569 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:10:35.569 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:10:35.613 INFO:teuthology.orchestra.run.smithi059.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:10:35.615 DEBUG:teuthology.orchestra.run.smithi059:> dpkg -s linux-image-generic 2024-04-26T02:10:35.631 INFO:teuthology.orchestra.run.smithi059.stdout:Package: linux-image-generic 2024-04-26T02:10:35.631 INFO:teuthology.orchestra.run.smithi059.stdout:Status: install ok installed 2024-04-26T02:10:35.631 INFO:teuthology.orchestra.run.smithi059.stdout:Priority: optional 2024-04-26T02:10:35.631 INFO:teuthology.orchestra.run.smithi059.stdout:Section: kernel 2024-04-26T02:10:35.631 INFO:teuthology.orchestra.run.smithi059.stdout:Installed-Size: 21 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: amd64 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Source: linux-meta 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Recommends: thermald 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:35.632 INFO:teuthology.orchestra.run.smithi059.stdout: available. 2024-04-26T02:10:35.632 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-04-26T02:10:35.677 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.SrfZhjQuWt 2024-04-26T02:10:35.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub/grub.cfg /tmp/tmp.SrfZhjQuWt 2024-04-26T02:10:35.700 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:35.725 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:35.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.SrfZhjQuWt 2024-04-26T02:10:35.851 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.SrfZhjQuWt is 10KB 2024-04-26T02:10:35.864 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.SrfZhjQuWt 2024-04-26T02:10:35.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:35.925 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:10:35.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T02:10:35.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:35.997 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T02:10:35.997 DEBUG:teuthology.orchestra.run.smithi059:> sudo update-grub 2024-04-26T02:10:36.007 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub' 2024-04-26T02:10:36.009 INFO:teuthology.orchestra.run.smithi142.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:36.011 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2024-04-26T02:10:36.070 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:36.076 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:36.149 INFO:teuthology.orchestra.run.smithi136.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:36.155 INFO:teuthology.orchestra.run.smithi136.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:36.180 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:36.186 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:36.323 INFO:teuthology.orchestra.run.smithi136.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:36.323 INFO:teuthology.orchestra.run.smithi136.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:36.323 INFO:teuthology.orchestra.run.smithi136.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:36.374 INFO:teuthology.orchestra.run.smithi136.stdout:done 2024-04-26T02:10:36.412 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:36.417 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:36.453 INFO:teuthology.orchestra.run.smithi142.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:36.459 INFO:teuthology.orchestra.run.smithi142.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:36.596 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:36.596 INFO:teuthology.orchestra.run.smithi142.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:36.596 INFO:teuthology.orchestra.run.smithi142.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:36.606 INFO:teuthology.orchestra.run.smithi142.stderr:done 2024-04-26T02:10:36.622 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2024-04-26T02:10:36.829 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2024-04-26T02:10:36.848 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 21 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2024-04-26T02:10:36.849 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:36.850 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:36.850 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2024-04-26T02:10:36.850 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T02:10:36.850 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T02:10:36.850 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T02:10:36.850 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-26T02:10:36.850 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T02:10:36.850 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get clean 2024-04-26T02:10:37.039 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-04-26T02:10:37.166 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:10:37.178 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:10:37.183 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:10:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub' 2024-04-26T02:10:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-04-26T02:10:37.204 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:10:37.346 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:37.352 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:37.597 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:37.604 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:37.655 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:37.773 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:37.773 INFO:teuthology.orchestra.run.smithi059.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:37.773 INFO:teuthology.orchestra.run.smithi059.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:37.793 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-04-26T02:10:37.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2024-04-26T02:10:38.525 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-26T02:10:38.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:10:38.606 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-26T02:10:38.801 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-04-26T02:10:38.802 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-04-26T02:10:38.982 INFO:teuthology.orchestra.run.smithi136.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T02:10:38.982 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:10:38.982 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:10:38.982 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:10:38.982 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:10:38.983 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:10:38.983 INFO:teuthology.orchestra.run.smithi136.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:10:38.983 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:10:39.024 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:10:39.026 DEBUG:teuthology.orchestra.run.smithi136:> dpkg -s linux-image-generic 2024-04-26T02:10:39.041 INFO:teuthology.orchestra.run.smithi136.stdout:Package: linux-image-generic 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Status: install ok installed 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Priority: optional 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Section: kernel 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Installed-Size: 21 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: amd64 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Source: linux-meta 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Recommends: thermald 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:39.042 INFO:teuthology.orchestra.run.smithi136.stdout: available. 2024-04-26T02:10:39.043 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-04-26T02:10:39.088 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.7QR4jpDYyh 2024-04-26T02:10:39.088 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub/grub.cfg /tmp/tmp.7QR4jpDYyh 2024-04-26T02:10:39.141 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.7QR4jpDYyh 2024-04-26T02:10:39.251 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.7QR4jpDYyh is 10KB 2024-04-26T02:10:39.264 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.7QR4jpDYyh 2024-04-26T02:10:39.269 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:39.323 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:10:39.323 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T02:10:39.323 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:39.395 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T02:10:39.395 DEBUG:teuthology.orchestra.run.smithi136:> sudo update-grub 2024-04-26T02:10:40.603 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub' 2024-04-26T02:10:40.605 INFO:teuthology.orchestra.run.smithi136.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:40.617 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-04-26T02:10:40.805 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:40.811 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:41.044 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:41.049 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:41.088 INFO:teuthology.orchestra.run.smithi136.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:41.093 INFO:teuthology.orchestra.run.smithi136.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:41.212 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:41.212 INFO:teuthology.orchestra.run.smithi136.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:41.212 INFO:teuthology.orchestra.run.smithi136.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:41.233 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-04-26T02:10:41.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-04-26T02:10:48.588 INFO:teuthology.orchestra.run.smithi175.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T02:10:48.588 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub' 2024-04-26T02:10:48.594 INFO:teuthology.orchestra.run.smithi175.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:48.611 INFO:teuthology.orchestra.run.smithi175.stdout:Generating grub configuration file ... 2024-04-26T02:10:48.974 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:48.994 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:49.378 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:49.384 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:49.459 INFO:teuthology.orchestra.run.smithi175.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:49.465 INFO:teuthology.orchestra.run.smithi175.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:49.648 INFO:teuthology.orchestra.run.smithi175.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:49.648 INFO:teuthology.orchestra.run.smithi175.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:49.649 INFO:teuthology.orchestra.run.smithi175.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:49.692 INFO:teuthology.orchestra.run.smithi175.stdout:done 2024-04-26T02:10:50.120 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-04-26T02:10:50.138 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 21 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:50.139 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-04-26T02:10:50.140 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-26T02:10:50.140 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T02:10:50.140 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T02:10:50.140 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-04-26T02:10:50.140 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T02:10:50.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get clean 2024-04-26T02:10:50.299 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-26T02:10:50.431 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:10:50.441 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:10:50.461 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:10:50.536 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:10:51.734 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T02:10:51.752 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T02:10:51.814 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T02:10:52.013 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-26T02:10:52.013 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-26T02:10:52.188 INFO:teuthology.orchestra.run.smithi175.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-26T02:10:52.188 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:10:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:10:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:10:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:10:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:10:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:10:52.189 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:10:52.229 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-26T02:10:52.231 DEBUG:teuthology.orchestra.run.smithi175:> dpkg -s linux-image-generic 2024-04-26T02:10:52.243 INFO:teuthology.orchestra.run.smithi175.stdout:Package: linux-image-generic 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Status: install ok installed 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Priority: optional 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Section: kernel 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Installed-Size: 21 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: amd64 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Source: linux-meta 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Version: 5.15.0.105.102 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Recommends: thermald 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout:Description: Generic Linux kernel image 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout: This package will always depend on the latest generic kernel image 2024-04-26T02:10:52.244 INFO:teuthology.orchestra.run.smithi175.stdout: available. 2024-04-26T02:10:52.245 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-26T02:10:52.289 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.z3wHnmDNL3 2024-04-26T02:10:52.289 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub/grub.cfg /tmp/tmp.z3wHnmDNL3 2024-04-26T02:10:52.344 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.z3wHnmDNL3 2024-04-26T02:10:52.467 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.z3wHnmDNL3 is 10KB 2024-04-26T02:10:52.481 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.z3wHnmDNL3 2024-04-26T02:10:52.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:52.546 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:10:52.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T02:10:52.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T02:10:52.612 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-26T02:10:52.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo update-grub 2024-04-26T02:10:53.779 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2024-04-26T02:10:53.780 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T02:10:53.782 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-04-26T02:10:54.031 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-26T02:10:54.037 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-26T02:10:54.341 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-26T02:10:54.347 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-26T02:10:54.390 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-26T02:10:54.395 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-26T02:10:54.545 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-26T02:10:54.545 INFO:teuthology.orchestra.run.smithi175.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-26T02:10:54.545 INFO:teuthology.orchestra.run.smithi175.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-26T02:10:54.571 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-04-26T02:10:54.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2024-04-26T02:11:06.634 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-04-26T02:11:06.634 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T02:11:06.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:11:07.799 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T02:11:07.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-26T02:11:07.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:11:11.243 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-26T02:11:11.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T02:11:11.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:11:24.595 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-04-26T02:11:24.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T02:11:24.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:11:41.215 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-26T02:11:45.822 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-26T02:11:50.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T02:11:50.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:11:54.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T02:11:54.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:12:07.814 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T02:12:08.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-26T02:12:13.214 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-26T02:12:16.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-26T02:12:16.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:12:20.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T02:12:20.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:12:20.953 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-26T02:12:21.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T02:12:21.767 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.15.0-105-generic"... 2024-04-26T02:12:21.768 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-26T02:12:21.772 INFO:teuthology.orchestra.run.smithi142.stdout:5.15.0-105-generic 2024-04-26T02:12:21.772 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T02:12:21.772 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T02:12:21.773 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T02:12:22.773 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-04-26T02:12:22.773 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T02:12:22.840 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-04-26T02:12:22.874 DEBUG:teuthology.parallel:result is None 2024-04-26T02:12:24.598 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T02:12:25.075 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-26T02:12:25.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T02:12:25.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:12:25.570 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-26T02:12:26.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-26T02:12:26.076 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-26T02:12:26.076 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-04-26T02:12:26.081 INFO:teuthology.orchestra.run.smithi059.stdout:5.15.0-105-generic 2024-04-26T02:12:26.081 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T02:12:26.082 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T02:12:26.082 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T02:12:26.326 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T02:12:26.327 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-26T02:12:26.327 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-26T02:12:26.375 INFO:teuthology.orchestra.run.smithi136.stdout:5.15.0-105-generic 2024-04-26T02:12:26.375 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T02:12:26.375 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T02:12:26.375 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T02:12:27.082 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T02:12:27.083 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T02:12:27.343 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2024-04-26T02:12:27.374 DEBUG:teuthology.parallel:result is None 2024-04-26T02:12:27.375 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-26T02:12:27.376 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T02:12:27.454 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-04-26T02:12:27.492 DEBUG:teuthology.parallel:result is None 2024-04-26T02:12:33.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T02:12:33.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:12:33.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-26T02:12:45.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T02:12:45.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:12:45.956 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-26T02:12:46.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T02:12:46.472 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-105-generic"... 2024-04-26T02:12:46.473 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-26T02:12:46.518 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-105-generic 2024-04-26T02:12:46.519 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-26T02:12:46.519 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T02:12:46.519 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T02:12:47.520 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-26T02:12:47.520 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T02:12:47.582 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2024-04-26T02:12:47.616 DEBUG:teuthology.parallel:result is None 2024-04-26T02:12:47.617 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T02:12:47.624 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T02:12:47.625 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T02:12:47.627 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T02:12:47.630 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T02:12:47.633 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T02:12:47.638 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T02:12:47.645 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T02:12:47.651 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T02:12:47.652 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T02:12:47.677 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T02:12:47.680 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T02:12:47.682 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T02:12:47.705 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T02:12:47.712 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T02:12:47.712 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T02:12:47.741 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T02:12:47.743 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T02:12:47.745 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T02:12:47.759 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.766 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.767 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.768 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.774 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.775 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.797 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.805 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T02:12:47.807 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T02:12:47.822 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T02:12:47.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T02:12:47.825 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T02:12:47.830 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T02:12:47.832 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T02:12:47.847 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T02:12:47.869 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T02:12:47.869 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T02:12:47.888 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T02:12:47.893 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T02:12:47.897 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T02:12:47.906 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T02:12:47.937 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T02:12:47.985 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:12:47.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T02:12:48.047 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T02:12:48.053 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T02:12:48.100 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:12:48.100 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T02:12:48.166 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T02:12:48.172 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T02:12:48.221 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:12:48.221 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T02:12:48.301 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T02:12:48.307 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T02:12:48.355 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:12:48.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T02:12:48.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-04-26T02:12:48.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-04-26T02:12:48.419 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-04-26T02:12:48.422 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-26T02:12:48.489 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T02:12:48.499 INFO:teuthology.task.internal:Starting timer... 2024-04-26T02:12:48.499 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T02:12:48.538 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T02:12:48.546 DEBUG:teuthology.task.selinux:Excluding smithi059: OS 'ubuntu' does not support SELinux 2024-04-26T02:12:48.546 DEBUG:teuthology.task.selinux:Excluding smithi136: OS 'ubuntu' does not support SELinux 2024-04-26T02:12:48.547 DEBUG:teuthology.task.selinux:Excluding smithi142: OS 'ubuntu' does not support SELinux 2024-04-26T02:12:48.547 DEBUG:teuthology.task.selinux:Excluding smithi175: OS 'ubuntu' does not support SELinux 2024-04-26T02:12:48.547 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T02:12:48.547 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T02:12:48.547 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T02:12:48.547 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T02:12:48.556 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T02:12:48.573 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T02:12:48.574 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi136.front.sepia.ceph.com,smithi142.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T02:20:01.857 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-04-26T02:20:01.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-26T02:20:01.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:20:01.947 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-26T02:20:02.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-26T02:20:02.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T02:20:02.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:20:02.109 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-26T02:20:02.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-26T02:20:02.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T02:20:02.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:20:02.267 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-26T02:20:02.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-26T02:20:02.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T02:20:02.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T02:20:02.428 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-26T02:20:02.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-26T02:20:02.508 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T02:20:02.518 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T02:20:02.519 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T02:20:02.519 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:20:02.521 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T02:20:02.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:20:02.524 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T02:20:02.524 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:20:02.526 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T02:20:02.526 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:20:02.550 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T02:20:02.550 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Command line: ntpd -gq 2024-04-26T02:20:02.550 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: ---------------------------------------------------- 2024-04-26T02:20:02.550 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T02:20:02.550 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T02:20:02.550 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: corporation. Support and training for ntp-4 are 2024-04-26T02:20:02.551 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: available at https://www.nwtime.org/support 2024-04-26T02:20:02.551 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: ---------------------------------------------------- 2024-04-26T02:20:02.552 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: proto: precision = 0.044 usec (-24) 2024-04-26T02:20:02.552 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: basedate set to 2022-02-04 2024-04-26T02:20:02.552 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: gps base set to 2022-02-06 (week 2196) 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi136.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Command line: ntpd -gq 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: ---------------------------------------------------- 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: corporation. Support and training for ntp-4 are 2024-04-26T02:20:02.553 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: available at https://www.nwtime.org/support 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: ---------------------------------------------------- 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: proto: precision = 0.066 usec (-24) 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: basedate set to 2022-02-04 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: gps base set to 2022-02-06 (week 2196) 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi059.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi059.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.554 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.555 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.555 INFO:teuthology.orchestra.run.smithi136.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.556 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Listen normally on 3 ens1f0 172.21.15.59:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Listen normally on 4 lo [::1]:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:192a%4]:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:02 ntpd[17107]: Listening on routing socket on fd #22 for interface updates 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Listen normally on 3 enp3s0f1 172.21.15.136:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Listen normally on 4 lo [::1]:123 2024-04-26T02:20:02.557 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e43%5]:123 2024-04-26T02:20:02.558 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:02 ntpd[17242]: Listening on routing socket on fd #22 for interface updates 2024-04-26T02:20:02.559 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T02:20:02.559 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Command line: ntpd -gq 2024-04-26T02:20:02.559 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: ---------------------------------------------------- 2024-04-26T02:20:02.559 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T02:20:02.559 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T02:20:02.559 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: corporation. Support and training for ntp-4 are 2024-04-26T02:20:02.560 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: available at https://www.nwtime.org/support 2024-04-26T02:20:02.560 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: ---------------------------------------------------- 2024-04-26T02:20:02.560 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: proto: precision = 0.045 usec (-24) 2024-04-26T02:20:02.560 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: basedate set to 2022-02-04 2024-04-26T02:20:02.560 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: gps base set to 2022-02-06 (week 2196) 2024-04-26T02:20:02.560 INFO:teuthology.orchestra.run.smithi142.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.560 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.561 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.561 INFO:teuthology.orchestra.run.smithi142.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.562 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T02:20:02.562 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T02:20:02.562 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T02:20:02.562 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Listen normally on 3 enp3s0f1 172.21.15.142:123 2024-04-26T02:20:02.562 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Listen normally on 4 lo [::1]:123 2024-04-26T02:20:02.562 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e0d%5]:123 2024-04-26T02:20:02.562 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:02 ntpd[17206]: Listening on routing socket on fd #22 for interface updates 2024-04-26T02:20:02.578 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-26T02:20:02.578 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Command line: ntpd -gq 2024-04-26T02:20:02.578 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: ---------------------------------------------------- 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: ntp-4 is maintained by Network Time Foundation, 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: corporation. Support and training for ntp-4 are 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: available at https://www.nwtime.org/support 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: ---------------------------------------------------- 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: proto: precision = 0.046 usec (-24) 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: basedate set to 2022-02-04 2024-04-26T02:20:02.579 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: gps base set to 2022-02-06 (week 2196) 2024-04-26T02:20:02.580 INFO:teuthology.orchestra.run.smithi175.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.580 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T02:20:02.580 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.580 INFO:teuthology.orchestra.run.smithi175.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T02:20:02.581 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T02:20:02.581 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T02:20:02.581 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T02:20:02.581 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Listen normally on 3 enp3s0f1 172.21.15.175:123 2024-04-26T02:20:02.581 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Listen normally on 4 lo [::1]:123 2024-04-26T02:20:02.582 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:71f1%5]:123 2024-04-26T02:20:02.582 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:02 ntpd[17211]: Listening on routing socket on fd #22 for interface updates 2024-04-26T02:20:03.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:03 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:03.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:03 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:03.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:03 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:03.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:03 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:03.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:03 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:03.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:03 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:03.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:03.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:03.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:03 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:03 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:03 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.553 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.553 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.553 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.553 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.553 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:04.554 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:04 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:04.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:04.557 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:04 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:04.558 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:04 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.558 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:04 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.558 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:04 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.559 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:04 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.559 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:04 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:04.559 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:04 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:04.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:04 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:04.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:04 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:04.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:04 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:04.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:04 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:05.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:05 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:05.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:05 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:05.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:05 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:05.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:05 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:05.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:05 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:05.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:05 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:05.552 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:05 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:05.552 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:05 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:05.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:05 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:05.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:05 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:05.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:05 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:05.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:05 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:05.553 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:05 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:05.553 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:05 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:05.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:05 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:05.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:05 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:05.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:05 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:05.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:05 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:05.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:05 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:05.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:05 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:06.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:06.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:06 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:06.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:06 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:06.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:06.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:06 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:06.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:06 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:06 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:06 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:06.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:06 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:06.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:06 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:06.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:06 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:07.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:07 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:07 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:07 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:07 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:07 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:07.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:07 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:07.552 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:07 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.552 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:07 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.552 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:07 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:07 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:07 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:07.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:07 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:07.553 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:07 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.553 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:07 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:07 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:07 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:07 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:07.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:07 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:07.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:07.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:07 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:08.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:08 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:08 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:08.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:08 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:08 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:08 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:08 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:08 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:08 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:08 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:09.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:09.551 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:09.552 INFO:teuthology.orchestra.run.smithi136.stdout:26 Apr 02:20:09 ntpd[17242]: ntpd: time slew -0.003731 s 2024-04-26T02:20:09.552 INFO:teuthology.orchestra.run.smithi136.stdout:ntpd: time slew -0.003731s 2024-04-26T02:20:09.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T02:20:09.552 INFO:teuthology.orchestra.run.smithi136.stderr:26 Apr 02:20:09 ntpd[17242]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T02:20:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.553 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:09.554 INFO:teuthology.orchestra.run.smithi059.stdout:26 Apr 02:20:09 ntpd[17107]: ntpd: time slew +0.001497 s 2024-04-26T02:20:09.554 INFO:teuthology.orchestra.run.smithi059.stdout:ntpd: time slew +0.001497s 2024-04-26T02:20:09.554 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T02:20:09.555 INFO:teuthology.orchestra.run.smithi059.stderr:26 Apr 02:20:09 ntpd[17107]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T02:20:09.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:09 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:09 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:09 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:09 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:09 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:09.556 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:09 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:09.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:09.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:09 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:09.607 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:20:09.607 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-04-26T02:20:09.608 INFO:teuthology.orchestra.run.smithi059.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:09.608 INFO:teuthology.orchestra.run.smithi059.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:09.608 INFO:teuthology.orchestra.run.smithi059.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:09.608 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:09.716 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:20:09.716 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2024-04-26T02:20:09.716 INFO:teuthology.orchestra.run.smithi136.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:09.717 INFO:teuthology.orchestra.run.smithi136.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:09.717 INFO:teuthology.orchestra.run.smithi136.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:09.717 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:10.554 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:10.555 INFO:teuthology.orchestra.run.smithi142.stdout:26 Apr 02:20:10 ntpd[17206]: ntpd: time slew -0.001907 s 2024-04-26T02:20:10.555 INFO:teuthology.orchestra.run.smithi142.stdout:ntpd: time slew -0.001907s 2024-04-26T02:20:10.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T02:20:10.555 INFO:teuthology.orchestra.run.smithi142.stderr:26 Apr 02:20:10 ntpd[17206]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T02:20:10.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:10.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:10.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T02:20:10.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T02:20:10.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T02:20:10.579 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T02:20:10.580 INFO:teuthology.orchestra.run.smithi175.stdout:26 Apr 02:20:10 ntpd[17211]: ntpd: time slew +0.000597 s 2024-04-26T02:20:10.580 INFO:teuthology.orchestra.run.smithi175.stdout:ntpd: time slew +0.000597s 2024-04-26T02:20:10.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T02:20:10.580 INFO:teuthology.orchestra.run.smithi175.stderr:26 Apr 02:20:10 ntpd[17211]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T02:20:10.612 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:20:10.612 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2024-04-26T02:20:10.612 INFO:teuthology.orchestra.run.smithi142.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.612 INFO:teuthology.orchestra.run.smithi142.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.612 INFO:teuthology.orchestra.run.smithi142.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.612 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.630 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:20:10.630 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-26T02:20:10.630 INFO:teuthology.orchestra.run.smithi175.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.630 INFO:teuthology.orchestra.run.smithi175.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.630 INFO:teuthology.orchestra.run.smithi175.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.630 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:20:10.631 INFO:teuthology.run_tasks:Running task install... 2024-04-26T02:20:10.641 DEBUG:teuthology.task.install:project ceph 2024-04-26T02:20:10.641 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'}} 2024-04-26T02:20:10.641 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'} 2024-04-26T02:20:10.641 INFO:teuthology.task.install:Using flavor: default 2024-04-26T02:20:10.647 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T02:20:10.647 INFO:teuthology.task.install:extra packages: [] 2024-04-26T02:20:10.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-key list | grep Ceph 2024-04-26T02:20:10.648 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-key list | grep Ceph 2024-04-26T02:20:10.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-key list | grep Ceph 2024-04-26T02:20:10.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-key list | grep Ceph 2024-04-26T02:20:10.710 INFO:teuthology.orchestra.run.smithi142.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T02:20:10.713 INFO:teuthology.orchestra.run.smithi136.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T02:20:10.715 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T02:20:10.729 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-26T02:20:10.737 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T02:20:10.738 INFO:teuthology.orchestra.run.smithi142.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T02:20:10.739 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T02:20:10.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:20:10.744 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T02:20:10.744 INFO:teuthology.orchestra.run.smithi136.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T02:20:10.744 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T02:20:10.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:20:10.747 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T02:20:10.747 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T02:20:10.748 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T02:20:10.748 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:20:10.754 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T02:20:10.754 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T02:20:10.755 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T02:20:10.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:20:10.878 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default/ 2024-04-26T02:20:10.878 INFO:teuthology.task.install.deb:Package version is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:10.893 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default/ 2024-04-26T02:20:10.893 INFO:teuthology.task.install.deb:Package version is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:11.040 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default/ 2024-04-26T02:20:11.040 INFO:teuthology.task.install.deb:Package version is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:11.045 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default/ 2024-04-26T02:20:11.045 INFO:teuthology.task.install.deb:Package version is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:11.183 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:20:11.233 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T02:20:11.235 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:20:11.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T02:20:11.285 DEBUG:teuthology.orchestra.run.smithi142:> sudo apt-get update 2024-04-26T02:20:11.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo apt-get update 2024-04-26T02:20:11.457 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:20:11.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T02:20:11.464 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:20:11.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T02:20:11.465 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:20:11.471 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-26T02:20:11.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-04-26T02:20:11.576 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:20:11.582 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:20:11.582 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:20:11.651 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:20:11.651 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:20:11.657 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:20:11.657 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-26T02:20:11.658 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:20:11.666 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:20:11.686 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:20:11.738 INFO:teuthology.orchestra.run.smithi142.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:20:11.742 INFO:teuthology.orchestra.run.smithi136.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:20:11.771 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-26T02:20:11.788 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T02:20:11.790 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T02:20:11.854 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-26T02:20:11.876 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T02:20:11.878 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T02:20:11.908 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T02:20:11.934 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-26T02:20:11.961 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy InRelease 2024-04-26T02:20:11.965 INFO:teuthology.orchestra.run.smithi136.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T02:20:11.968 INFO:teuthology.orchestra.run.smithi142.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T02:20:11.980 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T02:20:12.051 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-26T02:20:12.058 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-04-26T02:20:12.058 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T02:20:12.058 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T02:20:12.129 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-04-26T02:20:12.142 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-26T02:20:12.155 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T02:20:12.157 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-04-26T02:20:12.212 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T02:20:12.232 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-26T02:20:12.239 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 28.9 kB in 1s (37.9 kB/s) 2024-04-26T02:20:12.249 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 28.9 kB in 1s (37.8 kB/s) 2024-04-26T02:20:12.311 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 28.9 kB in 1s (46.1 kB/s) 2024-04-26T02:20:12.333 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-04-26T02:20:12.412 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 28.9 kB in 1s (38.6 kB/s) 2024-04-26T02:20:13.223 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-26T02:20:13.229 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-26T02:20:13.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2457-gddeaa917-1jammy cephadm=19.0.0-2457-gddeaa917-1jammy ceph-mds=19.0.0-2457-gddeaa917-1jammy ceph-mgr=19.0.0-2457-gddeaa917-1jammy ceph-common=19.0.0-2457-gddeaa917-1jammy ceph-fuse=19.0.0-2457-gddeaa917-1jammy ceph-test=19.0.0-2457-gddeaa917-1jammy ceph-volume=19.0.0-2457-gddeaa917-1jammy radosgw=19.0.0-2457-gddeaa917-1jammy python3-rados=19.0.0-2457-gddeaa917-1jammy python3-rgw=19.0.0-2457-gddeaa917-1jammy python3-cephfs=19.0.0-2457-gddeaa917-1jammy python3-rbd=19.0.0-2457-gddeaa917-1jammy libcephfs2=19.0.0-2457-gddeaa917-1jammy libcephfs-dev=19.0.0-2457-gddeaa917-1jammy librados2=19.0.0-2457-gddeaa917-1jammy librbd1=19.0.0-2457-gddeaa917-1jammy rbd-fuse=19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:13.245 DEBUG:teuthology.orchestra.run.smithi136:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2457-gddeaa917-1jammy cephadm=19.0.0-2457-gddeaa917-1jammy ceph-mds=19.0.0-2457-gddeaa917-1jammy ceph-mgr=19.0.0-2457-gddeaa917-1jammy ceph-common=19.0.0-2457-gddeaa917-1jammy ceph-fuse=19.0.0-2457-gddeaa917-1jammy ceph-test=19.0.0-2457-gddeaa917-1jammy ceph-volume=19.0.0-2457-gddeaa917-1jammy radosgw=19.0.0-2457-gddeaa917-1jammy python3-rados=19.0.0-2457-gddeaa917-1jammy python3-rgw=19.0.0-2457-gddeaa917-1jammy python3-cephfs=19.0.0-2457-gddeaa917-1jammy python3-rbd=19.0.0-2457-gddeaa917-1jammy libcephfs2=19.0.0-2457-gddeaa917-1jammy libcephfs-dev=19.0.0-2457-gddeaa917-1jammy librados2=19.0.0-2457-gddeaa917-1jammy librbd1=19.0.0-2457-gddeaa917-1jammy rbd-fuse=19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:13.289 INFO:teuthology.orchestra.run.smithi142.stdout:Reading package lists... 2024-04-26T02:20:13.307 INFO:teuthology.orchestra.run.smithi136.stdout:Reading package lists... 2024-04-26T02:20:13.308 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-26T02:20:13.323 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2457-gddeaa917-1jammy cephadm=19.0.0-2457-gddeaa917-1jammy ceph-mds=19.0.0-2457-gddeaa917-1jammy ceph-mgr=19.0.0-2457-gddeaa917-1jammy ceph-common=19.0.0-2457-gddeaa917-1jammy ceph-fuse=19.0.0-2457-gddeaa917-1jammy ceph-test=19.0.0-2457-gddeaa917-1jammy ceph-volume=19.0.0-2457-gddeaa917-1jammy radosgw=19.0.0-2457-gddeaa917-1jammy python3-rados=19.0.0-2457-gddeaa917-1jammy python3-rgw=19.0.0-2457-gddeaa917-1jammy python3-cephfs=19.0.0-2457-gddeaa917-1jammy python3-rbd=19.0.0-2457-gddeaa917-1jammy libcephfs2=19.0.0-2457-gddeaa917-1jammy libcephfs-dev=19.0.0-2457-gddeaa917-1jammy librados2=19.0.0-2457-gddeaa917-1jammy librbd1=19.0.0-2457-gddeaa917-1jammy rbd-fuse=19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:13.347 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T02:20:13.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2457-gddeaa917-1jammy cephadm=19.0.0-2457-gddeaa917-1jammy ceph-mds=19.0.0-2457-gddeaa917-1jammy ceph-mgr=19.0.0-2457-gddeaa917-1jammy ceph-common=19.0.0-2457-gddeaa917-1jammy ceph-fuse=19.0.0-2457-gddeaa917-1jammy ceph-test=19.0.0-2457-gddeaa917-1jammy ceph-volume=19.0.0-2457-gddeaa917-1jammy radosgw=19.0.0-2457-gddeaa917-1jammy python3-rados=19.0.0-2457-gddeaa917-1jammy python3-rgw=19.0.0-2457-gddeaa917-1jammy python3-cephfs=19.0.0-2457-gddeaa917-1jammy python3-rbd=19.0.0-2457-gddeaa917-1jammy libcephfs2=19.0.0-2457-gddeaa917-1jammy libcephfs-dev=19.0.0-2457-gddeaa917-1jammy librados2=19.0.0-2457-gddeaa917-1jammy librbd1=19.0.0-2457-gddeaa917-1jammy rbd-fuse=19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:20:13.386 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-26T02:20:13.424 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-26T02:20:13.466 INFO:teuthology.orchestra.run.smithi142.stdout:Building dependency tree... 2024-04-26T02:20:13.467 INFO:teuthology.orchestra.run.smithi142.stdout:Reading state information... 2024-04-26T02:20:13.507 INFO:teuthology.orchestra.run.smithi136.stdout:Building dependency tree... 2024-04-26T02:20:13.508 INFO:teuthology.orchestra.run.smithi136.stdout:Reading state information... 2024-04-26T02:20:13.589 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-04-26T02:20:13.589 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-04-26T02:20:13.622 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-26T02:20:13.623 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-26T02:20:13.638 INFO:teuthology.orchestra.run.smithi142.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:20:13.638 INFO:teuthology.orchestra.run.smithi142.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:20:13.638 INFO:teuthology.orchestra.run.smithi142.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:20:13.638 INFO:teuthology.orchestra.run.smithi142.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:20:13.638 INFO:teuthology.orchestra.run.smithi142.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:20:13.639 INFO:teuthology.orchestra.run.smithi142.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:20:13.639 INFO:teuthology.orchestra.run.smithi142.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:20:13.639 INFO:teuthology.orchestra.run.smithi142.stdout:The following additional packages will be installed: 2024-04-26T02:20:13.639 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.641 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T02:20:13.642 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet zip 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout:Suggested packages: 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout:Recommended packages: 2024-04-26T02:20:13.643 INFO:teuthology.orchestra.run.smithi142.stdout: btrfs-tools 2024-04-26T02:20:13.703 INFO:teuthology.orchestra.run.smithi136.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:20:13.703 INFO:teuthology.orchestra.run.smithi136.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:20:13.703 INFO:teuthology.orchestra.run.smithi136.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:20:13.703 INFO:teuthology.orchestra.run.smithi136.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:20:13.704 INFO:teuthology.orchestra.run.smithi136.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:20:13.704 INFO:teuthology.orchestra.run.smithi136.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:20:13.704 INFO:teuthology.orchestra.run.smithi136.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:20:13.705 INFO:teuthology.orchestra.run.smithi136.stdout:The following additional packages will be installed: 2024-04-26T02:20:13.705 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T02:20:13.705 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T02:20:13.705 INFO:teuthology.orchestra.run.smithi136.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T02:20:13.705 INFO:teuthology.orchestra.run.smithi136.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T02:20:13.706 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T02:20:13.706 INFO:teuthology.orchestra.run.smithi136.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T02:20:13.707 INFO:teuthology.orchestra.run.smithi136.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet zip 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout:Suggested packages: 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T02:20:13.708 INFO:teuthology.orchestra.run.smithi136.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T02:20:13.709 INFO:teuthology.orchestra.run.smithi136.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T02:20:13.709 INFO:teuthology.orchestra.run.smithi136.stdout:Recommended packages: 2024-04-26T02:20:13.709 INFO:teuthology.orchestra.run.smithi136.stdout: btrfs-tools 2024-04-26T02:20:13.741 INFO:teuthology.orchestra.run.smithi142.stdout:The following NEW packages will be installed: 2024-04-26T02:20:13.741 INFO:teuthology.orchestra.run.smithi142.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.742 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T02:20:13.743 INFO:teuthology.orchestra.run.smithi142.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T02:20:13.793 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:20:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:20:13.793 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:20:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:20:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:20:13.794 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:20:13.794 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:20:13.795 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-04-26T02:20:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T02:20:13.795 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T02:20:13.796 INFO:teuthology.orchestra.run.smithi059.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.797 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet zip 2024-04-26T02:20:13.798 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2024-04-26T02:20:13.799 INFO:teuthology.orchestra.run.smithi059.stdout: btrfs-tools 2024-04-26T02:20:13.808 INFO:teuthology.orchestra.run.smithi136.stdout:The following NEW packages will be installed: 2024-04-26T02:20:13.808 INFO:teuthology.orchestra.run.smithi136.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T02:20:13.808 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T02:20:13.808 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T02:20:13.809 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T02:20:13.809 INFO:teuthology.orchestra.run.smithi136.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.810 INFO:teuthology.orchestra.run.smithi136.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T02:20:13.811 INFO:teuthology.orchestra.run.smithi136.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T02:20:13.817 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T02:20:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-26T02:20:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-26T02:20:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-26T02:20:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-26T02:20:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-26T02:20:13.818 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T02:20:13.818 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-26T02:20:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.820 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-26T02:20:13.821 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet zip 2024-04-26T02:20:13.822 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-26T02:20:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-26T02:20:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-26T02:20:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-26T02:20:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-26T02:20:13.822 INFO:teuthology.orchestra.run.smithi175.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-26T02:20:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T02:20:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-26T02:20:13.823 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-04-26T02:20:13.823 INFO:teuthology.orchestra.run.smithi175.stdout: btrfs-tools 2024-04-26T02:20:13.904 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-04-26T02:20:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T02:20:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T02:20:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T02:20:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T02:20:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T02:20:13.905 INFO:teuthology.orchestra.run.smithi059.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T02:20:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T02:20:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T02:20:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T02:20:13.906 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T02:20:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T02:20:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.907 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T02:20:13.908 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T02:20:13.909 INFO:teuthology.orchestra.run.smithi059.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T02:20:13.922 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-26T02:20:13.922 INFO:teuthology.orchestra.run.smithi175.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T02:20:13.922 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T02:20:13.923 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-26T02:20:13.923 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-26T02:20:13.923 INFO:teuthology.orchestra.run.smithi175.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T02:20:13.923 INFO:teuthology.orchestra.run.smithi175.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-26T02:20:13.924 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-26T02:20:13.925 INFO:teuthology.orchestra.run.smithi175.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-26T02:20:13.931 INFO:teuthology.orchestra.run.smithi142.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T02:20:13.931 INFO:teuthology.orchestra.run.smithi142.stdout:Need to get 179 MB of archives. 2024-04-26T02:20:13.931 INFO:teuthology.orchestra.run.smithi142.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T02:20:13.931 INFO:teuthology.orchestra.run.smithi142.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T02:20:13.969 INFO:teuthology.orchestra.run.smithi059.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T02:20:13.970 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 179 MB of archives. 2024-04-26T02:20:13.970 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T02:20:13.970 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T02:20:13.993 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T02:20:13.993 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 179 MB of archives. 2024-04-26T02:20:13.993 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T02:20:13.993 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T02:20:13.999 INFO:teuthology.orchestra.run.smithi136.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-26T02:20:13.999 INFO:teuthology.orchestra.run.smithi136.stdout:Need to get 179 MB of archives. 2024-04-26T02:20:13.999 INFO:teuthology.orchestra.run.smithi136.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-26T02:20:13.999 INFO:teuthology.orchestra.run.smithi136.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-26T02:20:14.090 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T02:20:14.093 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T02:20:14.116 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T02:20:14.116 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T02:20:14.119 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T02:20:14.140 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T02:20:14.189 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T02:20:14.193 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T02:20:14.207 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T02:20:14.211 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T02:20:14.212 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T02:20:14.213 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T02:20:14.217 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T02:20:14.221 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T02:20:14.223 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T02:20:14.224 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T02:20:14.225 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T02:20:14.226 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T02:20:14.239 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T02:20:14.244 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T02:20:14.244 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T02:20:14.245 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T02:20:14.253 INFO:teuthology.orchestra.run.smithi142.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2457-gddeaa917-1jammy [3,545 kB] 2024-04-26T02:20:14.254 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T02:20:14.255 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T02:20:14.256 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T02:20:14.257 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T02:20:14.259 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T02:20:14.259 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T02:20:14.261 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T02:20:14.261 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T02:20:14.262 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T02:20:14.262 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T02:20:14.263 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T02:20:14.273 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T02:20:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T02:20:14.276 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T02:20:14.276 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T02:20:14.276 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T02:20:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T02:20:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T02:20:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T02:20:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T02:20:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T02:20:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T02:20:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T02:20:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T02:20:14.295 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T02:20:14.295 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T02:20:14.296 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T02:20:14.299 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T02:20:14.299 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T02:20:14.300 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T02:20:14.300 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T02:20:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T02:20:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T02:20:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T02:20:14.315 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T02:20:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T02:20:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T02:20:14.316 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T02:20:14.316 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T02:20:14.330 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2457-gddeaa917-1jammy [3,545 kB] 2024-04-26T02:20:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T02:20:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T02:20:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T02:20:14.333 INFO:teuthology.orchestra.run.smithi136.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2457-gddeaa917-1jammy [3,545 kB] 2024-04-26T02:20:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T02:20:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T02:20:14.335 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T02:20:14.336 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T02:20:14.336 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T02:20:14.345 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T02:20:14.346 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T02:20:14.347 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T02:20:14.348 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2457-gddeaa917-1jammy [3,545 kB] 2024-04-26T02:20:14.348 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T02:20:14.350 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T02:20:14.352 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T02:20:14.352 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T02:20:14.355 INFO:teuthology.orchestra.run.smithi142.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T02:20:14.357 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T02:20:14.358 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T02:20:14.358 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T02:20:14.361 INFO:teuthology.orchestra.run.smithi059.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T02:20:14.362 INFO:teuthology.orchestra.run.smithi059.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T02:20:14.368 INFO:teuthology.orchestra.run.smithi142.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T02:20:14.370 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T02:20:14.371 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T02:20:14.372 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T02:20:14.375 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T02:20:14.375 INFO:teuthology.orchestra.run.smithi175.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T02:20:14.379 INFO:teuthology.orchestra.run.smithi059.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T02:20:14.381 INFO:teuthology.orchestra.run.smithi059.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T02:20:14.386 INFO:teuthology.orchestra.run.smithi059.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T02:20:14.388 INFO:teuthology.orchestra.run.smithi059.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T02:20:14.390 INFO:teuthology.orchestra.run.smithi059.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T02:20:14.396 INFO:teuthology.orchestra.run.smithi059.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T02:20:14.407 INFO:teuthology.orchestra.run.smithi175.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T02:20:14.408 INFO:teuthology.orchestra.run.smithi175.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T02:20:14.411 INFO:teuthology.orchestra.run.smithi175.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T02:20:14.412 INFO:teuthology.orchestra.run.smithi175.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T02:20:14.413 INFO:teuthology.orchestra.run.smithi175.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T02:20:14.426 INFO:teuthology.orchestra.run.smithi136.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-26T02:20:14.438 INFO:teuthology.orchestra.run.smithi136.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-26T02:20:14.438 INFO:teuthology.orchestra.run.smithi175.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T02:20:14.448 INFO:teuthology.orchestra.run.smithi142.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T02:20:14.478 INFO:teuthology.orchestra.run.smithi059.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T02:20:14.480 INFO:teuthology.orchestra.run.smithi059.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T02:20:14.482 INFO:teuthology.orchestra.run.smithi059.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T02:20:14.483 INFO:teuthology.orchestra.run.smithi059.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T02:20:14.485 INFO:teuthology.orchestra.run.smithi059.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T02:20:14.520 INFO:teuthology.orchestra.run.smithi136.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-26T02:20:14.579 INFO:teuthology.orchestra.run.smithi059.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T02:20:14.582 INFO:teuthology.orchestra.run.smithi059.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T02:20:14.583 INFO:teuthology.orchestra.run.smithi059.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T02:20:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T02:20:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T02:20:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T02:20:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T02:20:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T02:20:14.608 INFO:teuthology.orchestra.run.smithi059.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T02:20:14.608 INFO:teuthology.orchestra.run.smithi059.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T02:20:14.609 INFO:teuthology.orchestra.run.smithi059.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T02:20:14.609 INFO:teuthology.orchestra.run.smithi059.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T02:20:14.610 INFO:teuthology.orchestra.run.smithi059.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T02:20:14.611 INFO:teuthology.orchestra.run.smithi059.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T02:20:14.612 INFO:teuthology.orchestra.run.smithi059.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T02:20:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T02:20:14.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T02:20:14.635 INFO:teuthology.orchestra.run.smithi175.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T02:20:14.638 INFO:teuthology.orchestra.run.smithi059.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T02:20:14.643 INFO:teuthology.orchestra.run.smithi059.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T02:20:14.646 INFO:teuthology.orchestra.run.smithi059.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T02:20:14.648 INFO:teuthology.orchestra.run.smithi059.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T02:20:14.655 INFO:teuthology.orchestra.run.smithi175.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T02:20:14.655 INFO:teuthology.orchestra.run.smithi175.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T02:20:14.656 INFO:teuthology.orchestra.run.smithi175.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T02:20:14.656 INFO:teuthology.orchestra.run.smithi175.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T02:20:14.656 INFO:teuthology.orchestra.run.smithi175.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T02:20:14.657 INFO:teuthology.orchestra.run.smithi175.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T02:20:14.657 INFO:teuthology.orchestra.run.smithi059.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T02:20:14.662 INFO:teuthology.orchestra.run.smithi059.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T02:20:14.669 INFO:teuthology.orchestra.run.smithi059.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T02:20:14.670 INFO:teuthology.orchestra.run.smithi059.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T02:20:14.671 INFO:teuthology.orchestra.run.smithi059.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T02:20:14.673 INFO:teuthology.orchestra.run.smithi175.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T02:20:14.673 INFO:teuthology.orchestra.run.smithi175.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T02:20:14.677 INFO:teuthology.orchestra.run.smithi175.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T02:20:14.678 INFO:teuthology.orchestra.run.smithi059.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T02:20:14.679 INFO:teuthology.orchestra.run.smithi059.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T02:20:14.681 INFO:teuthology.orchestra.run.smithi142.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T02:20:14.684 INFO:teuthology.orchestra.run.smithi059.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T02:20:14.684 INFO:teuthology.orchestra.run.smithi059.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T02:20:14.685 INFO:teuthology.orchestra.run.smithi059.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T02:20:14.692 INFO:teuthology.orchestra.run.smithi175.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T02:20:14.694 INFO:teuthology.orchestra.run.smithi142.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T02:20:14.695 INFO:teuthology.orchestra.run.smithi175.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T02:20:14.695 INFO:teuthology.orchestra.run.smithi175.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T02:20:14.698 INFO:teuthology.orchestra.run.smithi059.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T02:20:14.701 INFO:teuthology.orchestra.run.smithi175.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T02:20:14.701 INFO:teuthology.orchestra.run.smithi059.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T02:20:14.703 INFO:teuthology.orchestra.run.smithi059.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T02:20:14.710 INFO:teuthology.orchestra.run.smithi175.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T02:20:14.713 INFO:teuthology.orchestra.run.smithi175.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T02:20:14.713 INFO:teuthology.orchestra.run.smithi175.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T02:20:14.714 INFO:teuthology.orchestra.run.smithi059.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T02:20:14.714 INFO:teuthology.orchestra.run.smithi059.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T02:20:14.715 INFO:teuthology.orchestra.run.smithi059.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T02:20:14.721 INFO:teuthology.orchestra.run.smithi175.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T02:20:14.722 INFO:teuthology.orchestra.run.smithi175.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T02:20:14.724 INFO:teuthology.orchestra.run.smithi059.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T02:20:14.725 INFO:teuthology.orchestra.run.smithi175.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T02:20:14.725 INFO:teuthology.orchestra.run.smithi059.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T02:20:14.726 INFO:teuthology.orchestra.run.smithi142.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T02:20:14.735 INFO:teuthology.orchestra.run.smithi142.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T02:20:14.736 INFO:teuthology.orchestra.run.smithi142.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T02:20:14.737 INFO:teuthology.orchestra.run.smithi142.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T02:20:14.748 INFO:teuthology.orchestra.run.smithi175.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T02:20:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T02:20:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T02:20:14.752 INFO:teuthology.orchestra.run.smithi175.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T02:20:14.752 INFO:teuthology.orchestra.run.smithi136.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-26T02:20:14.756 INFO:teuthology.orchestra.run.smithi175.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T02:20:14.756 INFO:teuthology.orchestra.run.smithi142.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T02:20:14.763 INFO:teuthology.orchestra.run.smithi136.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-26T02:20:14.768 INFO:teuthology.orchestra.run.smithi175.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T02:20:14.769 INFO:teuthology.orchestra.run.smithi175.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T02:20:14.769 INFO:teuthology.orchestra.run.smithi175.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T02:20:14.773 INFO:teuthology.orchestra.run.smithi175.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T02:20:14.774 INFO:teuthology.orchestra.run.smithi175.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T02:20:14.792 INFO:teuthology.orchestra.run.smithi136.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-26T02:20:14.802 INFO:teuthology.orchestra.run.smithi136.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-26T02:20:14.803 INFO:teuthology.orchestra.run.smithi136.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-26T02:20:14.804 INFO:teuthology.orchestra.run.smithi136.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-26T02:20:14.823 INFO:teuthology.orchestra.run.smithi136.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-26T02:20:14.925 INFO:teuthology.orchestra.run.smithi142.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T02:20:14.983 INFO:teuthology.orchestra.run.smithi059.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2457-gddeaa917-1jammy [3,218 kB] 2024-04-26T02:20:14.991 INFO:teuthology.orchestra.run.smithi136.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-26T02:20:15.025 INFO:teuthology.orchestra.run.smithi175.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2457-gddeaa917-1jammy [3,218 kB] 2024-04-26T02:20:15.214 INFO:teuthology.orchestra.run.smithi059.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2457-gddeaa917-1jammy [711 kB] 2024-04-26T02:20:15.225 INFO:teuthology.orchestra.run.smithi136.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2457-gddeaa917-1jammy [3,218 kB] 2024-04-26T02:20:15.286 INFO:teuthology.orchestra.run.smithi059.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2457-gddeaa917-1jammy [356 kB] 2024-04-26T02:20:15.298 INFO:teuthology.orchestra.run.smithi059.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2457-gddeaa917-1jammy [32.8 kB] 2024-04-26T02:20:15.299 INFO:teuthology.orchestra.run.smithi059.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2457-gddeaa917-1jammy [180 kB] 2024-04-26T02:20:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2457-gddeaa917-1jammy [711 kB] 2024-04-26T02:20:15.360 INFO:teuthology.orchestra.run.smithi142.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T02:20:15.402 INFO:teuthology.orchestra.run.smithi136.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-26T02:20:15.415 INFO:teuthology.orchestra.run.smithi142.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T02:20:15.425 INFO:teuthology.orchestra.run.smithi142.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T02:20:15.436 INFO:teuthology.orchestra.run.smithi136.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-26T02:20:15.439 INFO:teuthology.orchestra.run.smithi136.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-26T02:20:15.449 INFO:teuthology.orchestra.run.smithi059.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2457-gddeaa917-1jammy [65.8 kB] 2024-04-26T02:20:15.452 INFO:teuthology.orchestra.run.smithi059.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2457-gddeaa917-1jammy [330 kB] 2024-04-26T02:20:15.461 INFO:teuthology.orchestra.run.smithi059.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2457-gddeaa917-1jammy [6,775 kB] 2024-04-26T02:20:15.486 INFO:teuthology.orchestra.run.smithi175.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2457-gddeaa917-1jammy [356 kB] 2024-04-26T02:20:15.493 INFO:teuthology.orchestra.run.smithi175.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2457-gddeaa917-1jammy [32.8 kB] 2024-04-26T02:20:15.494 INFO:teuthology.orchestra.run.smithi175.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2457-gddeaa917-1jammy [180 kB] 2024-04-26T02:20:15.518 INFO:teuthology.orchestra.run.smithi136.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T02:20:15.525 INFO:teuthology.orchestra.run.smithi175.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2457-gddeaa917-1jammy [65.8 kB] 2024-04-26T02:20:15.527 INFO:teuthology.orchestra.run.smithi175.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2457-gddeaa917-1jammy [330 kB] 2024-04-26T02:20:15.533 INFO:teuthology.orchestra.run.smithi175.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2457-gddeaa917-1jammy [6,775 kB] 2024-04-26T02:20:15.570 INFO:teuthology.orchestra.run.smithi136.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T02:20:15.592 INFO:teuthology.orchestra.run.smithi136.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T02:20:15.598 INFO:teuthology.orchestra.run.smithi136.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T02:20:15.599 INFO:teuthology.orchestra.run.smithi136.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T02:20:15.605 INFO:teuthology.orchestra.run.smithi136.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2457-gddeaa917-1jammy [711 kB] 2024-04-26T02:20:15.611 INFO:teuthology.orchestra.run.smithi136.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T02:20:15.612 INFO:teuthology.orchestra.run.smithi136.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T02:20:15.659 INFO:teuthology.orchestra.run.smithi142.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-26T02:20:15.679 INFO:teuthology.orchestra.run.smithi136.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2457-gddeaa917-1jammy [356 kB] 2024-04-26T02:20:15.707 INFO:teuthology.orchestra.run.smithi136.stdout:Get:27 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2457-gddeaa917-1jammy [32.8 kB] 2024-04-26T02:20:15.715 INFO:teuthology.orchestra.run.smithi136.stdout:Get:28 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2457-gddeaa917-1jammy [180 kB] 2024-04-26T02:20:15.734 INFO:teuthology.orchestra.run.smithi136.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2457-gddeaa917-1jammy [65.8 kB] 2024-04-26T02:20:15.737 INFO:teuthology.orchestra.run.smithi136.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2457-gddeaa917-1jammy [330 kB] 2024-04-26T02:20:15.779 INFO:teuthology.orchestra.run.smithi136.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T02:20:15.779 INFO:teuthology.orchestra.run.smithi136.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2457-gddeaa917-1jammy [6,775 kB] 2024-04-26T02:20:15.862 INFO:teuthology.orchestra.run.smithi136.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T02:20:15.890 INFO:teuthology.orchestra.run.smithi136.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T02:20:15.908 INFO:teuthology.orchestra.run.smithi136.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T02:20:15.953 INFO:teuthology.orchestra.run.smithi136.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T02:20:15.991 INFO:teuthology.orchestra.run.smithi142.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-26T02:20:16.048 INFO:teuthology.orchestra.run.smithi059.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2457-gddeaa917-1jammy [112 kB] 2024-04-26T02:20:16.052 INFO:teuthology.orchestra.run.smithi059.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2457-gddeaa917-1jammy [466 kB] 2024-04-26T02:20:16.097 INFO:teuthology.orchestra.run.smithi142.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-26T02:20:16.109 INFO:teuthology.orchestra.run.smithi059.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2457-gddeaa917-1jammy [25.6 MB] 2024-04-26T02:20:16.122 INFO:teuthology.orchestra.run.smithi142.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-26T02:20:16.127 INFO:teuthology.orchestra.run.smithi142.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-26T02:20:16.167 INFO:teuthology.orchestra.run.smithi136.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T02:20:16.172 INFO:teuthology.orchestra.run.smithi142.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-26T02:20:16.174 INFO:teuthology.orchestra.run.smithi142.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-26T02:20:16.182 INFO:teuthology.orchestra.run.smithi136.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T02:20:16.189 INFO:teuthology.orchestra.run.smithi136.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T02:20:16.195 INFO:teuthology.orchestra.run.smithi136.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T02:20:16.209 INFO:teuthology.orchestra.run.smithi175.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2457-gddeaa917-1jammy [112 kB] 2024-04-26T02:20:16.214 INFO:teuthology.orchestra.run.smithi175.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2457-gddeaa917-1jammy [466 kB] 2024-04-26T02:20:16.216 INFO:teuthology.orchestra.run.smithi136.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T02:20:16.220 INFO:teuthology.orchestra.run.smithi136.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T02:20:16.241 INFO:teuthology.orchestra.run.smithi175.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2457-gddeaa917-1jammy [25.6 MB] 2024-04-26T02:20:16.345 INFO:teuthology.orchestra.run.smithi142.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-26T02:20:16.385 INFO:teuthology.orchestra.run.smithi136.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T02:20:16.437 INFO:teuthology.orchestra.run.smithi142.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-26T02:20:16.464 INFO:teuthology.orchestra.run.smithi142.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2457-gddeaa917-1jammy [3,218 kB] 2024-04-26T02:20:16.468 INFO:teuthology.orchestra.run.smithi142.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-26T02:20:16.487 INFO:teuthology.orchestra.run.smithi142.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-26T02:20:16.529 INFO:teuthology.orchestra.run.smithi142.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-26T02:20:16.642 INFO:teuthology.orchestra.run.smithi136.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2457-gddeaa917-1jammy [112 kB] 2024-04-26T02:20:16.666 INFO:teuthology.orchestra.run.smithi136.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2457-gddeaa917-1jammy [466 kB] 2024-04-26T02:20:16.701 INFO:teuthology.orchestra.run.smithi136.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T02:20:16.716 INFO:teuthology.orchestra.run.smithi136.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2457-gddeaa917-1jammy [25.6 MB] 2024-04-26T02:20:16.739 INFO:teuthology.orchestra.run.smithi136.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T02:20:16.741 INFO:teuthology.orchestra.run.smithi142.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-26T02:20:16.751 INFO:teuthology.orchestra.run.smithi136.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T02:20:16.765 INFO:teuthology.orchestra.run.smithi142.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-26T02:20:16.772 INFO:teuthology.orchestra.run.smithi142.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-26T02:20:16.779 INFO:teuthology.orchestra.run.smithi142.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-26T02:20:16.799 INFO:teuthology.orchestra.run.smithi142.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T02:20:16.803 INFO:teuthology.orchestra.run.smithi142.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-26T02:20:16.954 INFO:teuthology.orchestra.run.smithi136.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T02:20:16.955 INFO:teuthology.orchestra.run.smithi136.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T02:20:16.961 INFO:teuthology.orchestra.run.smithi136.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T02:20:16.967 INFO:teuthology.orchestra.run.smithi136.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T02:20:16.970 INFO:teuthology.orchestra.run.smithi142.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-26T02:20:16.982 INFO:teuthology.orchestra.run.smithi136.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T02:20:17.002 INFO:teuthology.orchestra.run.smithi136.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T02:20:17.008 INFO:teuthology.orchestra.run.smithi136.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T02:20:17.183 INFO:teuthology.orchestra.run.smithi136.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T02:20:17.292 INFO:teuthology.orchestra.run.smithi142.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-26T02:20:17.346 INFO:teuthology.orchestra.run.smithi142.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-26T02:20:17.360 INFO:teuthology.orchestra.run.smithi142.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-26T02:20:17.438 INFO:teuthology.orchestra.run.smithi136.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T02:20:17.615 INFO:teuthology.orchestra.run.smithi136.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T02:20:17.628 INFO:teuthology.orchestra.run.smithi136.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T02:20:17.648 INFO:teuthology.orchestra.run.smithi136.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T02:20:17.713 INFO:teuthology.orchestra.run.smithi136.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T02:20:17.850 INFO:teuthology.orchestra.run.smithi142.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2457-gddeaa917-1jammy [711 kB] 2024-04-26T02:20:17.958 INFO:teuthology.orchestra.run.smithi142.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-26T02:20:17.959 INFO:teuthology.orchestra.run.smithi142.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-26T02:20:17.985 INFO:teuthology.orchestra.run.smithi142.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-26T02:20:18.002 INFO:teuthology.orchestra.run.smithi136.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T02:20:18.004 INFO:teuthology.orchestra.run.smithi136.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T02:20:18.007 INFO:teuthology.orchestra.run.smithi136.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T02:20:18.007 INFO:teuthology.orchestra.run.smithi136.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T02:20:18.009 INFO:teuthology.orchestra.run.smithi136.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T02:20:18.010 INFO:teuthology.orchestra.run.smithi142.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-26T02:20:18.101 INFO:teuthology.orchestra.run.smithi142.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-26T02:20:18.112 INFO:teuthology.orchestra.run.smithi142.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2457-gddeaa917-1jammy [356 kB] 2024-04-26T02:20:18.229 INFO:teuthology.orchestra.run.smithi136.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T02:20:18.233 INFO:teuthology.orchestra.run.smithi142.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-26T02:20:18.285 INFO:teuthology.orchestra.run.smithi142.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2457-gddeaa917-1jammy [32.8 kB] 2024-04-26T02:20:18.289 INFO:teuthology.orchestra.run.smithi142.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2457-gddeaa917-1jammy [180 kB] 2024-04-26T02:20:18.298 INFO:teuthology.orchestra.run.smithi142.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-26T02:20:18.386 INFO:teuthology.orchestra.run.smithi142.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2457-gddeaa917-1jammy [65.8 kB] 2024-04-26T02:20:18.392 INFO:teuthology.orchestra.run.smithi142.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2457-gddeaa917-1jammy [330 kB] 2024-04-26T02:20:18.550 INFO:teuthology.orchestra.run.smithi142.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2457-gddeaa917-1jammy [6,775 kB] 2024-04-26T02:20:18.569 INFO:teuthology.orchestra.run.smithi142.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-26T02:20:18.602 INFO:teuthology.orchestra.run.smithi175.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2457-gddeaa917-1jammy [5,084 kB] 2024-04-26T02:20:18.660 INFO:teuthology.orchestra.run.smithi136.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T02:20:18.666 INFO:teuthology.orchestra.run.smithi136.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T02:20:18.838 INFO:teuthology.orchestra.run.smithi142.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-26T02:20:18.897 INFO:teuthology.orchestra.run.smithi059.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2457-gddeaa917-1jammy [5,084 kB] 2024-04-26T02:20:18.941 INFO:teuthology.orchestra.run.smithi175.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2457-gddeaa917-1jammy [244 kB] 2024-04-26T02:20:18.956 INFO:teuthology.orchestra.run.smithi136.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T02:20:18.957 INFO:teuthology.orchestra.run.smithi175.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2457-gddeaa917-1jammy [124 kB] 2024-04-26T02:20:18.957 INFO:teuthology.orchestra.run.smithi136.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T02:20:18.959 INFO:teuthology.orchestra.run.smithi136.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T02:20:18.960 INFO:teuthology.orchestra.run.smithi136.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T02:20:18.962 INFO:teuthology.orchestra.run.smithi136.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T02:20:18.964 INFO:teuthology.orchestra.run.smithi136.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T02:20:18.965 INFO:teuthology.orchestra.run.smithi136.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T02:20:18.967 INFO:teuthology.orchestra.run.smithi136.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T02:20:18.973 INFO:teuthology.orchestra.run.smithi175.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2457-gddeaa917-1jammy [1,527 kB] 2024-04-26T02:20:19.018 INFO:teuthology.orchestra.run.smithi142.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-26T02:20:19.034 INFO:teuthology.orchestra.run.smithi142.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-26T02:20:19.055 INFO:teuthology.orchestra.run.smithi142.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-26T02:20:19.094 INFO:teuthology.orchestra.run.smithi175.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2457-gddeaa917-1jammy [6,245 kB] 2024-04-26T02:20:19.118 INFO:teuthology.orchestra.run.smithi142.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-26T02:20:19.149 INFO:teuthology.orchestra.run.smithi136.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T02:20:19.401 INFO:teuthology.orchestra.run.smithi059.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2457-gddeaa917-1jammy [244 kB] 2024-04-26T02:20:19.417 INFO:teuthology.orchestra.run.smithi059.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2457-gddeaa917-1jammy [124 kB] 2024-04-26T02:20:19.420 INFO:teuthology.orchestra.run.smithi142.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-26T02:20:19.423 INFO:teuthology.orchestra.run.smithi142.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-26T02:20:19.424 INFO:teuthology.orchestra.run.smithi059.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2457-gddeaa917-1jammy [1,527 kB] 2024-04-26T02:20:19.426 INFO:teuthology.orchestra.run.smithi142.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T02:20:19.426 INFO:teuthology.orchestra.run.smithi142.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-26T02:20:19.429 INFO:teuthology.orchestra.run.smithi142.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-26T02:20:19.564 INFO:teuthology.orchestra.run.smithi136.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T02:20:19.611 INFO:teuthology.orchestra.run.smithi136.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T02:20:19.614 INFO:teuthology.orchestra.run.smithi059.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2457-gddeaa917-1jammy [6,245 kB] 2024-04-26T02:20:19.646 INFO:teuthology.orchestra.run.smithi136.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T02:20:19.654 INFO:teuthology.orchestra.run.smithi175.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2457-gddeaa917-1jammy [22.7 MB] 2024-04-26T02:20:19.697 INFO:teuthology.orchestra.run.smithi142.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-26T02:20:19.743 INFO:teuthology.orchestra.run.smithi136.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T02:20:19.783 INFO:teuthology.orchestra.run.smithi136.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T02:20:19.794 INFO:teuthology.orchestra.run.smithi136.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T02:20:19.800 INFO:teuthology.orchestra.run.smithi136.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T02:20:19.847 INFO:teuthology.orchestra.run.smithi136.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T02:20:19.850 INFO:teuthology.orchestra.run.smithi136.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T02:20:19.871 INFO:teuthology.orchestra.run.smithi136.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T02:20:20.036 INFO:teuthology.orchestra.run.smithi136.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T02:20:20.138 INFO:teuthology.orchestra.run.smithi142.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-26T02:20:20.144 INFO:teuthology.orchestra.run.smithi142.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-26T02:20:20.274 INFO:teuthology.orchestra.run.smithi059.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2457-gddeaa917-1jammy [22.7 MB] 2024-04-26T02:20:20.310 INFO:teuthology.orchestra.run.smithi136.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T02:20:20.327 INFO:teuthology.orchestra.run.smithi136.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T02:20:20.447 INFO:teuthology.orchestra.run.smithi136.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2457-gddeaa917-1jammy [5,084 kB] 2024-04-26T02:20:20.479 INFO:teuthology.orchestra.run.smithi136.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T02:20:20.508 INFO:teuthology.orchestra.run.smithi136.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T02:20:20.516 INFO:teuthology.orchestra.run.smithi142.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-26T02:20:20.517 INFO:teuthology.orchestra.run.smithi142.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-26T02:20:20.527 INFO:teuthology.orchestra.run.smithi142.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-26T02:20:20.529 INFO:teuthology.orchestra.run.smithi142.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-26T02:20:20.531 INFO:teuthology.orchestra.run.smithi142.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-26T02:20:20.534 INFO:teuthology.orchestra.run.smithi142.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-26T02:20:20.536 INFO:teuthology.orchestra.run.smithi142.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-26T02:20:20.539 INFO:teuthology.orchestra.run.smithi142.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-26T02:20:20.665 INFO:teuthology.orchestra.run.smithi136.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T02:20:20.667 INFO:teuthology.orchestra.run.smithi136.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T02:20:20.669 INFO:teuthology.orchestra.run.smithi136.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T02:20:20.692 INFO:teuthology.orchestra.run.smithi136.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T02:20:20.696 INFO:teuthology.orchestra.run.smithi136.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T02:20:20.727 INFO:teuthology.orchestra.run.smithi142.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-26T02:20:21.067 INFO:teuthology.orchestra.run.smithi136.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2457-gddeaa917-1jammy [244 kB] 2024-04-26T02:20:21.113 INFO:teuthology.orchestra.run.smithi136.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2457-gddeaa917-1jammy [124 kB] 2024-04-26T02:20:21.124 INFO:teuthology.orchestra.run.smithi136.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2457-gddeaa917-1jammy [1,527 kB] 2024-04-26T02:20:21.285 INFO:teuthology.orchestra.run.smithi142.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2457-gddeaa917-1jammy [112 kB] 2024-04-26T02:20:21.304 INFO:teuthology.orchestra.run.smithi142.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-26T02:20:21.326 INFO:teuthology.orchestra.run.smithi136.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2457-gddeaa917-1jammy [6,245 kB] 2024-04-26T02:20:21.353 INFO:teuthology.orchestra.run.smithi142.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2457-gddeaa917-1jammy [466 kB] 2024-04-26T02:20:21.415 INFO:teuthology.orchestra.run.smithi142.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-26T02:20:21.534 INFO:teuthology.orchestra.run.smithi142.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2457-gddeaa917-1jammy [25.6 MB] 2024-04-26T02:20:21.545 INFO:teuthology.orchestra.run.smithi142.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-26T02:20:21.672 INFO:teuthology.orchestra.run.smithi175.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2457-gddeaa917-1jammy [14.1 kB] 2024-04-26T02:20:21.673 INFO:teuthology.orchestra.run.smithi175.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2457-gddeaa917-1jammy [869 kB] 2024-04-26T02:20:21.689 INFO:teuthology.orchestra.run.smithi175.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2457-gddeaa917-1jammy [2,438 kB] 2024-04-26T02:20:21.868 INFO:teuthology.orchestra.run.smithi175.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2457-gddeaa917-1jammy [791 kB] 2024-04-26T02:20:21.939 INFO:teuthology.orchestra.run.smithi175.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2457-gddeaa917-1jammy [147 kB] 2024-04-26T02:20:21.970 INFO:teuthology.orchestra.run.smithi175.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2457-gddeaa917-1jammy [2,293 kB] 2024-04-26T02:20:22.157 INFO:teuthology.orchestra.run.smithi175.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2457-gddeaa917-1jammy [8,625 kB] 2024-04-26T02:20:22.158 INFO:teuthology.orchestra.run.smithi142.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-26T02:20:22.185 INFO:teuthology.orchestra.run.smithi136.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2457-gddeaa917-1jammy [22.7 MB] 2024-04-26T02:20:22.774 INFO:teuthology.orchestra.run.smithi142.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-26T02:20:22.802 INFO:teuthology.orchestra.run.smithi059.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2457-gddeaa917-1jammy [14.1 kB] 2024-04-26T02:20:22.803 INFO:teuthology.orchestra.run.smithi059.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2457-gddeaa917-1jammy [869 kB] 2024-04-26T02:20:22.832 INFO:teuthology.orchestra.run.smithi059.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2457-gddeaa917-1jammy [2,438 kB] 2024-04-26T02:20:22.887 INFO:teuthology.orchestra.run.smithi142.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-26T02:20:22.913 INFO:teuthology.orchestra.run.smithi175.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2457-gddeaa917-1jammy [14.2 kB] 2024-04-26T02:20:22.914 INFO:teuthology.orchestra.run.smithi175.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2457-gddeaa917-1jammy [50.7 MB] 2024-04-26T02:20:22.946 INFO:teuthology.orchestra.run.smithi142.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-26T02:20:23.097 INFO:teuthology.orchestra.run.smithi059.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2457-gddeaa917-1jammy [791 kB] 2024-04-26T02:20:23.176 INFO:teuthology.orchestra.run.smithi059.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2457-gddeaa917-1jammy [147 kB] 2024-04-26T02:20:23.208 INFO:teuthology.orchestra.run.smithi059.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2457-gddeaa917-1jammy [2,293 kB] 2024-04-26T02:20:23.462 INFO:teuthology.orchestra.run.smithi059.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2457-gddeaa917-1jammy [8,625 kB] 2024-04-26T02:20:23.945 INFO:teuthology.orchestra.run.smithi142.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-26T02:20:24.068 INFO:teuthology.orchestra.run.smithi142.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-26T02:20:24.384 INFO:teuthology.orchestra.run.smithi059.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2457-gddeaa917-1jammy [14.2 kB] 2024-04-26T02:20:24.385 INFO:teuthology.orchestra.run.smithi059.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2457-gddeaa917-1jammy [50.7 MB] 2024-04-26T02:20:25.019 INFO:teuthology.orchestra.run.smithi142.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-26T02:20:25.201 INFO:teuthology.orchestra.run.smithi142.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T02:20:25.393 INFO:teuthology.orchestra.run.smithi136.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2457-gddeaa917-1jammy [14.1 kB] 2024-04-26T02:20:25.394 INFO:teuthology.orchestra.run.smithi136.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2457-gddeaa917-1jammy [869 kB] 2024-04-26T02:20:25.443 INFO:teuthology.orchestra.run.smithi136.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2457-gddeaa917-1jammy [2,438 kB] 2024-04-26T02:20:25.490 INFO:teuthology.orchestra.run.smithi142.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-26T02:20:25.508 INFO:teuthology.orchestra.run.smithi142.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-26T02:20:25.795 INFO:teuthology.orchestra.run.smithi142.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-26T02:20:25.861 INFO:teuthology.orchestra.run.smithi136.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2457-gddeaa917-1jammy [791 kB] 2024-04-26T02:20:25.973 INFO:teuthology.orchestra.run.smithi142.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-26T02:20:26.035 INFO:teuthology.orchestra.run.smithi136.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2457-gddeaa917-1jammy [147 kB] 2024-04-26T02:20:26.136 INFO:teuthology.orchestra.run.smithi136.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2457-gddeaa917-1jammy [2,293 kB] 2024-04-26T02:20:26.568 INFO:teuthology.orchestra.run.smithi136.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2457-gddeaa917-1jammy [8,625 kB] 2024-04-26T02:20:27.462 INFO:teuthology.orchestra.run.smithi175.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2457-gddeaa917-1jammy [121 kB] 2024-04-26T02:20:27.464 INFO:teuthology.orchestra.run.smithi175.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2457-gddeaa917-1jammy [39.0 kB] 2024-04-26T02:20:27.465 INFO:teuthology.orchestra.run.smithi175.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2457-gddeaa917-1jammy [13.4 MB] 2024-04-26T02:20:28.111 INFO:teuthology.orchestra.run.smithi142.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-26T02:20:28.160 INFO:teuthology.orchestra.run.smithi142.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-26T02:20:28.183 INFO:teuthology.orchestra.run.smithi142.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-26T02:20:28.476 INFO:teuthology.orchestra.run.smithi136.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2457-gddeaa917-1jammy [14.2 kB] 2024-04-26T02:20:28.477 INFO:teuthology.orchestra.run.smithi136.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2457-gddeaa917-1jammy [50.7 MB] 2024-04-26T02:20:28.480 INFO:teuthology.orchestra.run.smithi175.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2457-gddeaa917-1jammy [91.2 kB] 2024-04-26T02:20:28.621 INFO:teuthology.orchestra.run.smithi142.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-26T02:20:28.678 INFO:teuthology.orchestra.run.smithi142.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-26T02:20:29.039 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 179 MB in 15s (12.3 MB/s) 2024-04-26T02:20:29.166 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T02:20:29.256 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T02:20:29.262 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T02:20:29.331 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:20:29.651 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T02:20:29.678 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T02:20:29.718 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:20:29.765 INFO:teuthology.orchestra.run.smithi059.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2457-gddeaa917-1jammy [121 kB] 2024-04-26T02:20:29.768 INFO:teuthology.orchestra.run.smithi059.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2457-gddeaa917-1jammy [39.0 kB] 2024-04-26T02:20:29.769 INFO:teuthology.orchestra.run.smithi059.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2457-gddeaa917-1jammy [13.4 MB] 2024-04-26T02:20:30.127 INFO:teuthology.orchestra.run.smithi142.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2457-gddeaa917-1jammy [5,084 kB] 2024-04-26T02:20:30.538 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T02:20:30.564 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T02:20:30.604 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:20:30.999 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T02:20:31.026 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:31.074 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:31.242 INFO:teuthology.orchestra.run.smithi059.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2457-gddeaa917-1jammy [91.2 kB] 2024-04-26T02:20:31.321 INFO:teuthology.orchestra.run.smithi142.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2457-gddeaa917-1jammy [244 kB] 2024-04-26T02:20:31.371 INFO:teuthology.orchestra.run.smithi142.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2457-gddeaa917-1jammy [124 kB] 2024-04-26T02:20:31.387 INFO:teuthology.orchestra.run.smithi142.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2457-gddeaa917-1jammy [1,527 kB] 2024-04-26T02:20:31.460 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T02:20:31.486 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:31.527 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:31.695 INFO:teuthology.orchestra.run.smithi142.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2457-gddeaa917-1jammy [6,245 kB] 2024-04-26T02:20:31.835 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 179 MB in 17s (10.4 MB/s) 2024-04-26T02:20:31.872 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T02:20:31.898 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:31.938 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:31.997 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T02:20:32.100 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T02:20:32.106 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T02:20:32.187 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:20:32.283 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T02:20:32.309 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T02:20:32.358 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:20:32.474 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T02:20:32.502 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T02:20:32.541 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:20:32.619 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librados2. 2024-04-26T02:20:32.645 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../007-librados2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:32.677 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:32.977 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T02:20:33.004 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T02:20:33.044 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:20:33.048 INFO:teuthology.orchestra.run.smithi142.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2457-gddeaa917-1jammy [22.7 MB] 2024-04-26T02:20:33.148 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librbd1. 2024-04-26T02:20:33.175 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../008-librbd1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:33.221 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:33.464 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T02:20:33.490 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:33.538 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:33.699 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T02:20:33.726 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:33.765 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:33.958 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T02:20:33.985 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:34.025 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:34.068 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rados. 2024-04-26T02:20:34.094 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:34.143 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:34.311 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T02:20:34.338 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:34.378 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:34.462 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T02:20:34.488 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:34.529 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:34.747 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T02:20:34.774 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T02:20:34.789 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T02:20:34.805 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:34.814 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:20:34.848 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:35.100 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librados2. 2024-04-26T02:20:35.116 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../007-librados2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:35.142 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T02:20:35.150 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:35.169 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:35.225 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:35.545 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T02:20:35.572 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T02:20:35.611 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librbd1. 2024-04-26T02:20:35.611 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:20:35.638 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../008-librbd1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:35.677 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:35.948 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T02:20:35.974 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T02:20:36.014 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T02:20:36.272 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T02:20:36.275 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T02:20:36.290 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:36.298 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:36.333 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:36.338 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:36.633 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rados. 2024-04-26T02:20:36.659 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:36.695 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T02:20:36.699 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:36.721 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T02:20:36.761 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:20:36.985 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T02:20:37.012 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:37.043 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:37.047 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T02:20:37.062 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T02:20:37.105 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:20:37.130 INFO:teuthology.orchestra.run.smithi136.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2457-gddeaa917-1jammy [121 kB] 2024-04-26T02:20:37.219 INFO:teuthology.orchestra.run.smithi136.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2457-gddeaa917-1jammy [39.0 kB] 2024-04-26T02:20:37.220 INFO:teuthology.orchestra.run.smithi136.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2457-gddeaa917-1jammy [13.4 MB] 2024-04-26T02:20:37.295 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T02:20:37.311 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:37.354 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:37.391 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T02:20:37.407 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T02:20:37.441 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:20:37.665 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T02:20:37.691 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:37.694 INFO:teuthology.orchestra.run.smithi142.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2457-gddeaa917-1jammy [14.1 kB] 2024-04-26T02:20:37.695 INFO:teuthology.orchestra.run.smithi142.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2457-gddeaa917-1jammy [869 kB] 2024-04-26T02:20:37.726 INFO:teuthology.orchestra.run.smithi142.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2457-gddeaa917-1jammy [2,438 kB] 2024-04-26T02:20:37.728 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua5.1. 2024-04-26T02:20:37.731 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:37.754 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T02:20:37.786 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:20:37.913 INFO:teuthology.orchestra.run.smithi142.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2457-gddeaa917-1jammy [791 kB] 2024-04-26T02:20:37.982 INFO:teuthology.orchestra.run.smithi142.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2457-gddeaa917-1jammy [147 kB] 2024-04-26T02:20:37.986 INFO:teuthology.orchestra.run.smithi142.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2457-gddeaa917-1jammy [2,293 kB] 2024-04-26T02:20:38.059 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T02:20:38.086 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T02:20:38.098 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-any. 2024-04-26T02:20:38.118 INFO:teuthology.orchestra.run.smithi136.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2457-gddeaa917-1jammy [91.2 kB] 2024-04-26T02:20:38.124 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T02:20:38.126 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:20:38.164 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T02:20:38.168 INFO:teuthology.orchestra.run.smithi142.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2457-gddeaa917-1jammy [8,625 kB] 2024-04-26T02:20:38.408 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package zip. 2024-04-26T02:20:38.423 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T02:20:38.429 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T02:20:38.455 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T02:20:38.466 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T02:20:38.495 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T02:20:38.673 INFO:teuthology.orchestra.run.smithi136.stdout:Fetched 179 MB in 24s (7,386 kB/s) 2024-04-26T02:20:38.706 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T02:20:38.721 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:38.764 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:38.778 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package unzip. 2024-04-26T02:20:38.803 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T02:20:38.804 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T02:20:38.837 INFO:teuthology.orchestra.run.smithi142.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2457-gddeaa917-1jammy [14.2 kB] 2024-04-26T02:20:38.838 INFO:teuthology.orchestra.run.smithi142.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2457-gddeaa917-1jammy [50.7 MB] 2024-04-26T02:20:38.844 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:20:38.902 INFO:teuthology.orchestra.run.smithi136.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T02:20:38.908 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T02:20:38.993 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:20:39.111 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T02:20:39.137 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T02:20:39.177 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:20:39.198 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package luarocks. 2024-04-26T02:20:39.224 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T02:20:39.264 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:20:39.339 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T02:20:39.365 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T02:20:39.406 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:20:39.438 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T02:20:39.454 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T02:20:39.496 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:20:39.657 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librgw2. 2024-04-26T02:20:39.675 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T02:20:39.684 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../025-librgw2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:39.701 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T02:20:39.724 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:39.742 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:20:39.799 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T02:20:39.815 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T02:20:39.857 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:20:40.161 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua5.1. 2024-04-26T02:20:40.178 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T02:20:40.187 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T02:20:40.205 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:40.227 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:20:40.253 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:40.260 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T02:20:40.286 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:40.501 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:40.530 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-any. 2024-04-26T02:20:40.557 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T02:20:40.597 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T02:20:40.632 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T02:20:40.647 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:40.681 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:40.771 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T02:20:40.797 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T02:20:40.837 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:20:40.849 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package zip. 2024-04-26T02:20:40.865 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T02:20:40.908 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T02:20:40.985 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T02:20:41.011 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:41.051 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:41.157 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T02:20:41.183 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:41.203 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package unzip. 2024-04-26T02:20:41.223 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:41.229 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T02:20:41.261 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:20:41.404 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T02:20:41.430 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T02:20:41.479 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:20:41.652 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-common. 2024-04-26T02:20:41.673 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package luarocks. 2024-04-26T02:20:41.678 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:41.700 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T02:20:41.718 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:41.740 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:20:41.799 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librados2. 2024-04-26T02:20:41.825 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../007-librados2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:41.865 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:42.088 INFO:teuthology.orchestra.run.smithi142.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2457-gddeaa917-1jammy [121 kB] 2024-04-26T02:20:42.090 INFO:teuthology.orchestra.run.smithi142.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2457-gddeaa917-1jammy [39.0 kB] 2024-04-26T02:20:42.091 INFO:teuthology.orchestra.run.smithi142.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2457-gddeaa917-1jammy [13.4 MB] 2024-04-26T02:20:42.122 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librgw2. 2024-04-26T02:20:42.149 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../025-librgw2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:42.210 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:42.302 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librbd1. 2024-04-26T02:20:42.328 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../008-librbd1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:42.360 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:42.741 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T02:20:42.757 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:42.779 INFO:teuthology.orchestra.run.smithi142.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri2-testing-2024-04-24-0914-squid/ddeaa91797339a19172c3036ff48cca58c12f448/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2457-gddeaa917-1jammy [91.2 kB] 2024-04-26T02:20:42.791 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:42.813 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T02:20:42.839 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:42.880 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:43.103 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T02:20:43.129 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T02:20:43.157 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rados. 2024-04-26T02:20:43.164 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-base. 2024-04-26T02:20:43.169 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:20:43.180 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:43.191 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:43.224 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:43.249 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:43.344 INFO:teuthology.orchestra.run.smithi142.stdout:Fetched 179 MB in 29s (6,182 kB/s) 2024-04-26T02:20:43.472 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T02:20:43.499 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:43.519 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-26T02:20:43.538 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:43.620 INFO:teuthology.orchestra.run.smithi142.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-26T02:20:43.626 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-26T02:20:43.660 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T02:20:43.686 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:43.709 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:20:43.718 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:43.877 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T02:20:43.903 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T02:20:43.920 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T02:20:43.939 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:43.943 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:20:43.967 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-common. 2024-04-26T02:20:43.979 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:43.994 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:44.004 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T02:20:44.031 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-26T02:20:44.033 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:44.062 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:20:44.229 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T02:20:44.256 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T02:20:44.282 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T02:20:44.296 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:20:44.308 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:44.348 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:44.424 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T02:20:44.450 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-26T02:20:44.490 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:20:44.651 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T02:20:44.666 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T02:20:44.677 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T02:20:44.692 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T02:20:44.718 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:20:44.740 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:20:45.060 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T02:20:45.069 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T02:20:45.070 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T02:20:45.086 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T02:20:45.095 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:45.097 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T02:20:45.126 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:20:45.137 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T02:20:45.160 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:45.373 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T02:20:45.396 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:45.429 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T02:20:45.440 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:45.456 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T02:20:45.480 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-base. 2024-04-26T02:20:45.496 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:20:45.507 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:45.522 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T02:20:45.548 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:45.580 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:45.824 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T02:20:45.850 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T02:20:45.890 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T02:20:45.925 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T02:20:45.951 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-26T02:20:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:45.991 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:20:46.235 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-portend. 2024-04-26T02:20:46.261 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T02:20:46.301 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T02:20:46.345 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-26T02:20:46.371 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-26T02:20:46.468 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:20:46.535 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T02:20:46.561 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T02:20:46.601 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:20:46.837 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T02:20:46.852 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T02:20:46.898 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:20:46.902 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T02:20:46.929 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T02:20:46.968 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:20:47.199 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T02:20:47.225 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T02:20:47.246 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T02:20:47.265 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:20:47.273 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T02:20:47.304 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:20:47.305 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T02:20:47.332 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T02:20:47.371 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T02:20:47.439 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librados2. 2024-04-26T02:20:47.466 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../007-librados2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:47.498 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:47.574 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T02:20:47.594 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package lua5.1. 2024-04-26T02:20:47.601 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T02:20:47.620 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T02:20:47.640 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:20:47.660 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:20:47.682 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T02:20:47.709 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T02:20:47.749 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:20:47.944 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T02:20:47.950 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librbd1. 2024-04-26T02:20:47.955 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package lua-any. 2024-04-26T02:20:47.970 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T02:20:47.971 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T02:20:47.976 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../008-librbd1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:48.005 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T02:20:48.010 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:20:48.017 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:48.094 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T02:20:48.121 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T02:20:48.160 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T02:20:48.258 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package zip. 2024-04-26T02:20:48.263 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T02:20:48.284 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T02:20:48.290 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T02:20:48.321 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:20:48.324 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T02:20:48.472 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T02:20:48.478 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T02:20:48.498 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T02:20:48.504 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:48.538 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T02:20:48.544 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:48.557 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T02:20:48.584 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T02:20:48.624 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T02:20:48.727 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package unzip. 2024-04-26T02:20:48.754 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T02:20:48.794 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:20:48.822 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rados. 2024-04-26T02:20:48.837 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:48.858 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T02:20:48.872 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:48.884 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T02:20:48.924 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:20:48.927 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-portend. 2024-04-26T02:20:48.954 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T02:20:48.993 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T02:20:49.140 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package luarocks. 2024-04-26T02:20:49.166 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T02:20:49.177 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-mako. 2024-04-26T02:20:49.192 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T02:20:49.203 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T02:20:49.206 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:20:49.218 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:49.235 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:20:49.258 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:49.296 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T02:20:49.324 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T02:20:49.363 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T02:20:49.477 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T02:20:49.492 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:49.522 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T02:20:49.527 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:49.548 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T02:20:49.580 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:20:49.589 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package librgw2. 2024-04-26T02:20:49.616 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../025-librgw2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:49.616 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T02:20:49.643 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T02:20:49.655 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:49.673 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:20:49.821 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T02:20:49.837 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:49.871 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:49.899 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T02:20:49.926 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T02:20:49.966 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:20:50.053 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T02:20:50.080 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T02:20:50.119 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T02:20:50.191 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T02:20:50.217 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:50.252 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webob. 2024-04-26T02:20:50.258 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:50.278 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T02:20:50.300 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T02:20:50.318 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:20:50.326 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-26T02:20:50.358 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:20:50.430 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T02:20:50.458 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T02:20:50.497 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T02:20:50.594 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T02:20:50.621 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T02:20:50.660 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:20:50.671 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T02:20:50.677 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T02:20:50.698 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T02:20:50.703 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-26T02:20:50.741 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:20:50.744 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-26T02:20:50.750 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T02:20:50.777 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T02:20:50.816 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:20:50.913 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T02:20:50.940 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:50.972 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:51.005 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T02:20:51.015 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T02:20:51.031 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:51.031 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T02:20:51.065 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:20:51.071 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:51.128 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-mako. 2024-04-26T02:20:51.155 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T02:20:51.194 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:20:51.310 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-paste. 2024-04-26T02:20:51.325 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T02:20:51.367 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-common. 2024-04-26T02:20:51.368 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:20:51.393 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:51.399 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T02:20:51.414 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-26T02:20:51.433 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:51.449 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:20:51.539 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T02:20:51.566 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T02:20:51.605 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:20:51.688 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T02:20:51.702 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-26T02:20:51.703 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T02:20:51.728 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-26T02:20:51.746 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:20:51.768 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:20:51.892 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T02:20:51.919 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T02:20:51.958 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:20:51.999 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T02:20:52.025 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T02:20:52.065 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:20:52.096 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-26T02:20:52.122 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-26T02:20:52.163 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:20:52.211 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webob. 2024-04-26T02:20:52.238 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T02:20:52.269 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:20:52.368 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T02:20:52.395 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T02:20:52.435 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T02:20:52.499 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua5.1. 2024-04-26T02:20:52.525 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-26T02:20:52.566 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:20:52.614 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T02:20:52.641 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T02:20:52.683 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:20:52.746 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T02:20:52.772 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T02:20:52.812 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:20:52.831 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-base. 2024-04-26T02:20:52.857 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:52.869 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua-any. 2024-04-26T02:20:52.884 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-26T02:20:52.906 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:52.919 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-26T02:20:53.000 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T02:20:53.027 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T02:20:53.067 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:20:53.163 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package zip. 2024-04-26T02:20:53.178 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-26T02:20:53.184 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T02:20:53.210 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T02:20:53.221 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking zip (3.0-12build2) ... 2024-04-26T02:20:53.250 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T02:20:53.328 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-paste. 2024-04-26T02:20:53.355 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T02:20:53.386 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:20:53.470 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T02:20:53.494 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T02:20:53.534 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:20:53.541 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package unzip. 2024-04-26T02:20:53.556 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-26T02:20:53.578 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-idna. 2024-04-26T02:20:53.599 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:20:53.605 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T02:20:53.645 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T02:20:53.739 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T02:20:53.766 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T02:20:53.806 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:20:53.912 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T02:20:53.914 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T02:20:53.939 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T02:20:53.940 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T02:20:53.961 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package luarocks. 2024-04-26T02:20:53.972 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:20:53.979 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:20:53.987 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-26T02:20:54.028 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:20:54.083 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T02:20:54.100 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T02:20:54.134 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:20:54.259 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests. 2024-04-26T02:20:54.285 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T02:20:54.290 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T02:20:54.317 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:20:54.317 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T02:20:54.357 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:20:54.369 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package librgw2. 2024-04-26T02:20:54.384 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../025-librgw2_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:54.404 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T02:20:54.427 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:54.430 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T02:20:54.470 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T02:20:54.603 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T02:20:54.629 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T02:20:54.660 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T02:20:54.669 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:20:54.686 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T02:20:54.726 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:20:54.781 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T02:20:54.808 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T02:20:54.848 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:20:54.929 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T02:20:54.947 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T02:20:54.956 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:54.963 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:54.996 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:54.997 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:55.004 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T02:20:55.031 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T02:20:55.071 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:20:55.236 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T02:20:55.263 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T02:20:55.314 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T02:20:55.340 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-26T02:20:55.365 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T02:20:55.367 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-26T02:20:55.392 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T02:20:55.394 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T02:20:55.407 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:20:55.421 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:55.432 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T02:20:55.460 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:55.639 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-idna. 2024-04-26T02:20:55.666 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T02:20:55.685 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T02:20:55.705 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T02:20:55.711 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:55.718 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-portend. 2024-04-26T02:20:55.743 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:55.744 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T02:20:55.746 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T02:20:55.762 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T02:20:55.785 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T02:20:55.796 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:20:56.025 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T02:20:56.037 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T02:20:56.041 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T02:20:56.053 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T02:20:56.058 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T02:20:56.083 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:20:56.084 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T02:20:56.089 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T02:20:56.124 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T02:20:56.197 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-common. 2024-04-26T02:20:56.223 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:56.263 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:56.393 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T02:20:56.411 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests. 2024-04-26T02:20:56.419 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T02:20:56.439 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T02:20:56.459 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:20:56.478 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:20:56.485 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T02:20:56.512 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:56.552 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:56.739 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T02:20:56.755 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T02:20:56.796 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T02:20:56.823 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T02:20:56.854 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T02:20:56.918 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:20:56.955 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T02:20:56.981 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:57.021 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:57.149 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T02:20:57.176 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T02:20:57.216 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T02:20:57.242 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T02:20:57.258 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:20:57.300 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:57.519 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T02:20:57.545 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T02:20:57.575 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T02:20:57.585 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:20:57.601 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:57.633 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:57.668 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-base. 2024-04-26T02:20:57.694 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:57.713 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T02:20:57.741 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:57.744 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:57.780 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:57.888 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-mako. 2024-04-26T02:20:57.914 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T02:20:57.954 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:20:58.091 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T02:20:58.119 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T02:20:58.158 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:20:58.233 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T02:20:58.248 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T02:20:58.283 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:20:58.339 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-26T02:20:58.365 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-26T02:20:58.405 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:20:58.427 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T02:20:58.454 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T02:20:58.485 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T02:20:58.561 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T02:20:58.587 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T02:20:58.627 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:20:58.650 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cheroot. 2024-04-26T02:20:58.676 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-26T02:20:58.711 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph. 2024-04-26T02:20:58.716 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:20:58.726 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../066-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:58.769 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:58.797 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T02:20:58.824 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:58.863 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:58.922 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webob. 2024-04-26T02:20:58.948 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T02:20:58.988 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:20:59.011 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-26T02:20:59.038 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-26T02:20:59.078 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:20:59.088 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T02:20:59.115 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:59.155 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:59.266 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T02:20:59.294 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:59.333 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:59.350 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T02:20:59.376 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T02:20:59.380 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-26T02:20:59.396 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-26T02:20:59.420 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:20:59.439 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:20:59.508 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T02:20:59.535 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:20:59.574 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:20:59.711 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T02:20:59.737 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T02:20:59.758 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-26T02:20:59.777 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:20:59.784 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-26T02:20:59.825 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:20:59.960 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephadm. 2024-04-26T02:20:59.976 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../069-cephadm_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:00.019 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:00.037 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T02:21:00.047 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-paste. 2024-04-26T02:21:00.064 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:00.073 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T02:21:00.095 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:00.095 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempora. 2024-04-26T02:21:00.121 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-26T02:21:00.130 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:21:00.161 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-26T02:21:00.338 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T02:21:00.365 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T02:21:00.404 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:00.450 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T02:21:00.465 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T02:21:00.508 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:21:00.647 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-portend. 2024-04-26T02:21:00.662 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-26T02:21:00.691 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T02:21:00.705 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-26T02:21:00.717 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:00.757 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:00.811 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T02:21:00.838 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T02:21:00.878 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:21:01.008 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-26T02:21:01.034 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-26T02:21:01.075 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-26T02:21:01.089 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph. 2024-04-26T02:21:01.106 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../066-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:01.139 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:01.147 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T02:21:01.174 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T02:21:01.206 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T02:21:01.320 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T02:21:01.346 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-26T02:21:01.377 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:21:01.450 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T02:21:01.475 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T02:21:01.477 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:01.501 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T02:21:01.517 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:01.542 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:21:01.673 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T02:21:01.699 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-26T02:21:01.731 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-26T02:21:01.871 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T02:21:01.889 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T02:21:01.898 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:01.915 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T02:21:01.954 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:01.955 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T02:21:02.025 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T02:21:02.052 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-26T02:21:02.053 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-babel. 2024-04-26T02:21:02.069 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:02.092 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-26T02:21:02.112 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:02.258 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-idna. 2024-04-26T02:21:02.285 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T02:21:02.325 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T02:21:02.331 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephadm. 2024-04-26T02:21:02.359 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../069-cephadm_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:02.398 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:02.403 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T02:21:02.429 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-26T02:21:02.431 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T02:21:02.458 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T02:21:02.470 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:21:02.498 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:02.578 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T02:21:02.593 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T02:21:02.636 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:21:02.717 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T02:21:02.745 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T02:21:02.747 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-mako. 2024-04-26T02:21:02.763 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-26T02:21:02.784 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:02.797 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:21:02.884 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T02:21:02.911 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:02.931 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-requests. 2024-04-26T02:21:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:02.957 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T02:21:02.997 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:21:03.084 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T02:21:03.110 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T02:21:03.120 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T02:21:03.142 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:21:03.147 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:03.187 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:03.304 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T02:21:03.308 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T02:21:03.331 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T02:21:03.335 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T02:21:03.370 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:03.375 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:21:03.420 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T02:21:03.446 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-26T02:21:03.486 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:21:03.673 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-routes. 2024-04-26T02:21:03.679 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T02:21:03.700 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T02:21:03.706 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:03.739 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:03.744 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:03.814 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webob. 2024-04-26T02:21:03.840 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-26T02:21:03.881 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:21:04.076 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T02:21:04.103 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:04.142 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:04.192 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-babel. 2024-04-26T02:21:04.219 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:04.242 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T02:21:04.258 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:04.268 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-26T02:21:04.300 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T02:21:04.312 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:21:04.326 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:04.366 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:04.562 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T02:21:04.588 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T02:21:04.603 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T02:21:04.618 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-26T02:21:04.619 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T02:21:04.634 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T02:21:04.636 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:04.653 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:21:04.677 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:21:04.939 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-paste. 2024-04-26T02:21:04.956 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T02:21:04.966 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-26T02:21:04.980 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T02:21:04.983 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:05.006 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:21:05.007 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T02:21:05.014 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:05.047 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T02:21:05.317 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T02:21:05.332 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-26T02:21:05.359 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T02:21:05.367 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:21:05.383 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T02:21:05.386 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T02:21:05.397 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T02:21:05.410 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:05.417 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:05.425 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T02:21:05.450 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:05.455 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:05.645 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T02:21:05.672 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-26T02:21:05.695 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-routes. 2024-04-26T02:21:05.711 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:21:05.722 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T02:21:05.761 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:05.812 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T02:21:05.838 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:05.869 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:05.959 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T02:21:05.986 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T02:21:06.014 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T02:21:06.025 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:06.041 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-26T02:21:06.081 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-26T02:21:06.081 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T02:21:06.109 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:06.148 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:06.375 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T02:21:06.402 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-26T02:21:06.419 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T02:21:06.442 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:21:06.447 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T02:21:06.457 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T02:21:06.483 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:06.495 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:06.531 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:06.890 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T02:21:06.917 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T02:21:06.964 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-certifi. 2024-04-26T02:21:06.990 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-26T02:21:07.030 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-26T02:21:07.106 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:07.291 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-idna. 2024-04-26T02:21:07.306 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-26T02:21:07.349 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-26T02:21:07.494 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T02:21:07.511 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T02:21:07.561 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:07.601 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph. 2024-04-26T02:21:07.616 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../066-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:07.659 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:07.694 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-urllib3. 2024-04-26T02:21:07.720 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-26T02:21:07.760 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:21:07.789 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T02:21:07.817 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:07.933 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:07.979 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T02:21:08.005 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:08.037 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:08.056 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T02:21:08.081 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-requests. 2024-04-26T02:21:08.084 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T02:21:08.107 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-26T02:21:08.123 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:08.147 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:21:08.416 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T02:21:08.442 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:08.458 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T02:21:08.482 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:08.484 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-26T02:21:08.493 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T02:21:08.520 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T02:21:08.524 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:21:08.559 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:08.811 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T02:21:08.826 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:08.844 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T02:21:08.860 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package cephadm. 2024-04-26T02:21:08.869 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:08.870 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T02:21:08.871 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T02:21:08.886 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../069-cephadm_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:08.898 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T02:21:08.902 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:08.926 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:08.937 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:09.205 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T02:21:09.215 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T02:21:09.233 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T02:21:09.242 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:09.272 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:09.282 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:09.354 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T02:21:09.381 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T02:21:09.421 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:09.593 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T02:21:09.600 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T02:21:09.608 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-26T02:21:09.627 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T02:21:09.651 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:21:09.654 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T02:21:09.667 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:21:09.671 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:09.707 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T02:21:09.734 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:09.773 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:09.789 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:09.954 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T02:21:09.981 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-26T02:21:10.003 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T02:21:10.021 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-26T02:21:10.030 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T02:21:10.069 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T02:21:10.315 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T02:21:10.342 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:10.356 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T02:21:10.372 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T02:21:10.373 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:10.406 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T02:21:10.684 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T02:21:10.700 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T02:21:10.734 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:21:10.751 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T02:21:10.761 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-babel. 2024-04-26T02:21:10.778 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T02:21:10.788 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:10.817 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:10.851 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:10.910 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T02:21:10.936 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:10.976 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:11.012 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T02:21:11.039 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T02:21:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T02:21:11.104 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T02:21:11.131 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T02:21:11.170 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:11.181 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T02:21:11.208 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T02:21:11.256 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:11.365 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T02:21:11.392 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T02:21:11.423 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:21:11.457 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T02:21:11.473 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T02:21:11.507 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:21:11.576 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T02:21:11.602 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:11.605 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T02:21:11.632 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:11.642 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:11.672 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:11.785 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T02:21:11.812 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T02:21:11.851 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T02:21:12.004 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T02:21:12.031 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T02:21:12.070 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:12.095 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T02:21:12.111 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:12.153 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:12.332 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-routes. 2024-04-26T02:21:12.358 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T02:21:12.390 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:12.398 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T02:21:12.426 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T02:21:12.463 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T02:21:12.480 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T02:21:12.508 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T02:21:12.547 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:12.685 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T02:21:12.700 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph. 2024-04-26T02:21:12.712 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:12.715 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../066-ceph_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:12.743 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:12.758 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:12.783 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T02:21:12.811 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T02:21:12.849 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:21:12.859 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T02:21:12.886 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:12.925 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:13.086 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T02:21:13.112 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:13.154 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:13.178 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package jq. 2024-04-26T02:21:13.194 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:13.202 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T02:21:13.227 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T02:21:13.230 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T02:21:13.269 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T02:21:13.472 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package socat. 2024-04-26T02:21:13.474 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T02:21:13.499 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T02:21:13.501 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:13.532 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:13.538 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:13.556 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T02:21:13.583 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T02:21:13.614 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:21:13.850 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T02:21:13.877 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T02:21:13.907 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T02:21:13.910 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package cephadm. 2024-04-26T02:21:13.916 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:13.923 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T02:21:13.937 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../069-cephadm_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:13.956 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:13.976 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:14.244 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T02:21:14.270 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-test. 2024-04-26T02:21:14.273 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:14.296 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T02:21:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:14.311 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:14.322 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-26T02:21:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:14.371 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:14.452 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T02:21:14.479 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T02:21:14.518 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:14.605 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T02:21:14.633 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T02:21:14.672 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:14.681 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-26T02:21:14.698 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:14.740 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:14.855 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T02:21:14.871 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T02:21:14.904 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:15.008 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T02:21:15.036 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:15.074 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:15.216 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T02:21:15.243 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T02:21:15.282 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:15.344 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package jq. 2024-04-26T02:21:15.361 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:15.402 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T02:21:15.657 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package socat. 2024-04-26T02:21:15.673 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T02:21:15.715 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:15.769 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-babel. 2024-04-26T02:21:15.797 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-26T02:21:15.836 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:15.958 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T02:21:15.986 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:15.993 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T02:21:16.010 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T02:21:16.051 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:16.110 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:16.147 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T02:21:16.174 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-26T02:21:16.214 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:16.405 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-test. 2024-04-26T02:21:16.422 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:16.472 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:16.559 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T02:21:16.585 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:16.626 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:16.666 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T02:21:16.693 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:16.732 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:16.962 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T02:21:16.988 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T02:21:17.028 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:17.044 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T02:21:17.063 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T02:21:17.072 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:17.090 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T02:21:17.111 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:17.121 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:17.331 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-routes. 2024-04-26T02:21:17.358 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-26T02:21:17.397 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:17.422 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T02:21:17.433 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T02:21:17.449 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T02:21:17.460 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T02:21:17.488 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:17.499 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:17.734 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T02:21:17.761 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:17.800 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:17.818 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T02:21:17.828 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T02:21:17.845 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T02:21:17.855 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T02:21:17.884 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:17.911 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:21:18.247 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T02:21:18.271 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T02:21:18.274 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T02:21:18.299 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T02:21:18.313 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T02:21:18.346 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:18.601 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T02:21:18.628 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T02:21:18.667 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T02:21:18.760 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package pkg-config. 2024-04-26T02:21:18.788 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T02:21:18.801 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T02:21:18.818 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:18.826 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:18.851 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:18.937 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T02:21:18.964 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T02:21:18.995 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:21:19.039 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-26T02:21:19.055 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-26T02:21:19.070 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T02:21:19.086 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T02:21:19.097 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:19.120 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:19.147 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T02:21:19.163 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:19.205 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:19.282 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T02:21:19.309 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T02:21:19.349 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T02:21:19.500 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T02:21:19.528 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T02:21:19.542 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T02:21:19.566 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:19.570 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T02:21:19.609 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:19.609 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T02:21:19.635 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-26T02:21:19.660 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T02:21:19.675 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:19.687 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T02:21:19.726 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:21:19.854 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T02:21:19.882 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T02:21:19.894 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T02:21:19.911 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T02:21:19.912 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:19.944 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T02:21:20.012 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-26T02:21:20.039 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-26T02:21:20.070 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:20.256 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T02:21:20.284 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T02:21:20.291 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T02:21:20.319 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T02:21:20.323 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:20.357 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T02:21:20.358 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:20.374 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:20.381 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T02:21:20.407 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:20.408 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-26T02:21:20.447 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:20.643 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T02:21:20.670 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T02:21:20.709 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:20.710 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T02:21:20.737 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T02:21:20.776 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:20.796 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package pkg-config. 2024-04-26T02:21:20.824 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T02:21:20.862 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:21.045 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-py. 2024-04-26T02:21:21.073 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T02:21:21.105 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T02:21:21.112 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T02:21:21.124 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T02:21:21.132 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:21.140 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T02:21:21.171 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:21.182 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:21.348 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T02:21:21.376 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:21.415 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T02:21:21.441 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package jq. 2024-04-26T02:21:21.443 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T02:21:21.468 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:21.481 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:21.500 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:21.507 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T02:21:21.618 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T02:21:21.647 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T02:21:21.685 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:21.760 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package socat. 2024-04-26T02:21:21.787 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T02:21:21.818 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:21.946 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T02:21:21.972 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T02:21:21.987 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T02:21:22.010 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:22.016 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T02:21:22.071 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T02:21:22.112 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T02:21:22.136 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T02:21:22.179 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:22.313 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-toml. 2024-04-26T02:21:22.339 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T02:21:22.380 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T02:21:22.399 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T02:21:22.428 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T02:21:22.466 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:22.478 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T02:21:22.505 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-26T02:21:22.525 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-test. 2024-04-26T02:21:22.544 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:22.553 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:22.592 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:22.666 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T02:21:22.694 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T02:21:22.718 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T02:21:22.732 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:22.735 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T02:21:22.768 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:22.831 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T02:21:22.858 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-26T02:21:22.914 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:23.078 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T02:21:23.105 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T02:21:23.140 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-py. 2024-04-26T02:21:23.141 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T02:21:23.144 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:23.179 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T02:21:23.234 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T02:21:23.261 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-26T02:21:23.300 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:21:23.405 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T02:21:23.433 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T02:21:23.471 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:23.474 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T02:21:23.492 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T02:21:23.524 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:23.570 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T02:21:23.597 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-26T02:21:23.628 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-26T02:21:23.912 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T02:21:23.940 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T02:21:23.949 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T02:21:23.976 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-26T02:21:23.978 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:24.015 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-26T02:21:24.242 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package radosgw. 2024-04-26T02:21:24.266 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../116-radosgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:24.289 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-toml. 2024-04-26T02:21:24.309 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:24.318 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T02:21:24.335 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T02:21:24.355 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T02:21:24.362 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-26T02:21:24.403 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:21:24.683 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T02:21:24.712 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T02:21:24.712 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T02:21:24.739 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-26T02:21:24.749 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:24.779 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-26T02:21:24.979 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T02:21:25.007 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:25.046 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:25.082 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T02:21:25.103 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T02:21:25.104 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T02:21:25.110 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-26T02:21:25.119 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:25.132 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T02:21:25.149 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:21:25.153 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:25.169 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:25.317 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T02:21:25.332 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:25.366 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:25.432 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:25.439 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T02:21:25.468 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T02:21:25.505 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:25.666 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:21:25.678 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T02:21:25.705 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T02:21:25.744 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:25.784 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:25.788 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T02:21:25.815 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:25.854 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:26.039 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T02:21:26.082 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T02:21:26.110 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T02:21:26.149 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:26.182 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T02:21:26.201 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package radosgw. 2024-04-26T02:21:26.209 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-26T02:21:26.230 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../116-radosgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:26.248 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:26.259 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:26.355 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T02:21:26.528 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T02:21:26.556 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T02:21:26.593 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T02:21:26.594 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:26.620 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:26.676 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:26.782 INFO:teuthology.orchestra.run.smithi175.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T02:21:26.853 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:26.904 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package jq. 2024-04-26T02:21:26.920 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-26T02:21:26.953 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-26T02:21:26.991 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package pkg-config. 2024-04-26T02:21:27.019 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T02:21:27.049 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:27.129 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T02:21:27.157 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:27.198 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package socat. 2024-04-26T02:21:27.203 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:27.214 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-26T02:21:27.256 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:27.294 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T02:21:27.310 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T02:21:27.352 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:27.378 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user cephadm....done 2024-04-26T02:21:27.517 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:27.576 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T02:21:27.592 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-26T02:21:27.634 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:27.739 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T02:21:27.766 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T02:21:27.805 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:27.834 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:21:27.989 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-test. 2024-04-26T02:21:28.005 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:28.009 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:21:28.047 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:28.085 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:21:28.108 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T02:21:28.136 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T02:21:28.175 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T02:21:28.243 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:28.336 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:28.462 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:21:28.478 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T02:21:28.505 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T02:21:28.538 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T02:21:28.544 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:28.713 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:28.842 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T02:21:28.872 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T02:21:28.900 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T02:21:28.939 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:28.964 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:21:29.090 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T02:21:29.245 INFO:teuthology.orchestra.run.smithi059.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T02:21:29.284 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-py. 2024-04-26T02:21:29.311 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T02:21:29.345 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:29.358 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T02:21:29.392 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:29.679 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T02:21:29.706 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T02:21:29.745 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:29.761 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:29.929 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user cephadm....done 2024-04-26T02:21:30.020 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T02:21:30.111 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:21:30.208 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T02:21:30.235 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T02:21:30.265 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:30.288 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:21:30.318 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T02:21:30.346 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2457-gddeaa917-1jammy_all.deb ... 2024-04-26T02:21:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:30.529 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:21:30.556 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:21:30.560 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-toml. 2024-04-26T02:21:30.578 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T02:21:30.618 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T02:21:30.721 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T02:21:30.748 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:30.780 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:30.788 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:30.807 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:30.906 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:21:30.921 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T02:21:30.948 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T02:21:30.987 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:31.067 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:31.073 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-26T02:21:31.089 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-26T02:21:31.124 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:31.166 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:31.308 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T02:21:31.335 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T02:21:31.360 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:31.374 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:31.426 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:21:31.445 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-26T02:21:31.472 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-26T02:21:31.511 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:31.551 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T02:21:31.619 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:31.643 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T02:21:31.660 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T02:21:31.702 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:31.745 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:31.854 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:21:31.861 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:31.890 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T02:21:31.918 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-26T02:21:31.955 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:21:31.956 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:32.189 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:21:32.222 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:32.395 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package pkg-config. 2024-04-26T02:21:32.423 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-26T02:21:32.431 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package radosgw. 2024-04-26T02:21:32.459 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../116-radosgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:32.461 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:32.497 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:32.507 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T02:21:32.629 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T02:21:32.663 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T02:21:32.714 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T02:21:32.727 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:21:32.730 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-26T02:21:32.764 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:32.791 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:21:32.861 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:33.026 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:21:33.159 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-26T02:21:33.186 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-26T02:21:33.225 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:33.229 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:33.284 INFO:teuthology.orchestra.run.smithi136.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T02:21:33.285 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:33.311 INFO:teuthology.orchestra.run.smithi136.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:33.350 INFO:teuthology.orchestra.run.smithi136.stdout:Unpacking rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:33.355 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T02:21:33.470 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T02:21:33.497 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T02:21:33.528 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T02:21:33.553 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:33.631 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:33.646 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:33.796 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:33.840 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T02:21:33.867 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-26T02:21:33.899 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:33.906 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:33.913 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:21:34.048 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:34.072 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:34.201 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T02:21:34.206 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:34.208 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T02:21:34.228 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-26T02:21:34.267 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:34.301 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T02:21:34.326 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:34.332 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:21:34.451 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:21:34.604 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-py. 2024-04-26T02:21:34.631 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-26T02:21:34.632 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T02:21:34.670 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-26T02:21:34.693 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:21:34.998 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pygments. 2024-04-26T02:21:35.003 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:21:35.026 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-26T02:21:35.062 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T02:21:35.064 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:35.069 INFO:teuthology.orchestra.run.smithi136.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T02:21:35.091 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T02:21:35.124 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:35.146 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:21:35.254 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:21:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:35.380 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:35.506 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:21:35.544 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T02:21:35.571 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-26T02:21:35.608 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user cephadm....done 2024-04-26T02:21:35.610 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:35.615 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:35.741 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T02:21:35.791 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:21:35.807 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:35.854 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-toml. 2024-04-26T02:21:35.882 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-26T02:21:35.912 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-26T02:21:35.992 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:36.078 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:21:36.183 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T02:21:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T02:21:36.243 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-26T02:21:36.251 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:36.282 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:36.327 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:36.435 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:21:36.453 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:21:36.569 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T02:21:36.577 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T02:21:36.605 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-26T02:21:36.687 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:36.704 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:36.811 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:21:36.868 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:36.963 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:21:37.090 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T02:21:37.096 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T02:21:37.096 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:21:37.112 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-26T02:21:37.146 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:37.372 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:21:37.383 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:37.431 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:21:37.632 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:21:37.682 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:37.726 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:37.758 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:37.808 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:37.884 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:21:37.925 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package radosgw. 2024-04-26T02:21:37.953 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../116-radosgw_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:37.977 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T02:21:37.991 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:38.110 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T02:21:38.210 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:38.253 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:21:38.427 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:38.521 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:21:38.644 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T02:21:38.780 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:38.786 INFO:teuthology.orchestra.run.smithi142.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T02:21:38.814 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2457-gddeaa917-1jammy_amd64.deb ... 2024-04-26T02:21:38.852 INFO:teuthology.orchestra.run.smithi142.stdout:Unpacking rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:38.904 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:21:39.040 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:39.166 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-26T02:21:39.274 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:39.280 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:21:39.432 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-26T02:21:39.558 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-26T02:21:39.573 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:21:39.600 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:39.633 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:39.760 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:39.818 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-26T02:21:39.885 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:21:39.918 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:39.924 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:21:40.011 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:21:40.052 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T02:21:40.167 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:40.176 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-26T02:21:40.271 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:21:40.285 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:40.320 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:21:40.421 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:40.522 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:21:40.586 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T02:21:40.600 INFO:teuthology.orchestra.run.smithi142.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-26T02:21:40.657 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T02:21:40.685 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T02:21:40.718 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:40.748 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:21:40.823 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:40.858 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:40.912 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:41.083 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T02:21:41.217 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:41.326 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:41.343 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T02:21:41.452 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:41.536 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user cephadm....done 2024-04-26T02:21:41.619 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:41.692 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-26T02:21:41.761 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:21:41.887 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:42.004 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T02:21:42.010 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-26T02:21:42.093 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:42.180 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T02:21:42.253 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-26T02:21:42.255 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T02:21:42.306 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:42.344 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:42.353 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-26T02:21:42.479 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T02:21:42.506 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:21:42.605 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T02:21:42.746 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:21:42.749 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T02:21:42.856 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-26T02:21:42.872 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:42.966 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:21:42.990 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-26T02:21:42.998 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:21:43.038 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:21:43.168 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T02:21:43.217 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:21:43.292 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:43.292 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-26T02:21:43.343 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:43.461 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:43.469 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:21:43.568 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T02:21:43.570 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:21:43.644 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-26T02:21:43.770 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:43.846 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:21:43.860 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:43.895 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-26T02:21:43.986 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:44.139 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:21:44.162 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T02:21:44.171 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-26T02:21:44.296 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:21:44.390 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:21:44.413 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:21:44.431 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-26T02:21:44.525 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:44.547 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T02:21:44.651 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:44.682 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-26T02:21:44.740 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T02:21:44.790 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:21:44.807 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T02:21:44.925 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-26T02:21:44.978 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:45.058 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:21:45.058 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:21:45.095 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:45.184 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-argparse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:45.309 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T02:21:45.376 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:21:45.435 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-26T02:21:45.455 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:21:45.536 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-26T02:21:45.560 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:21:45.627 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:45.637 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-26T02:21:45.686 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T02:21:45.714 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T02:21:45.753 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:45.763 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-26T02:21:45.840 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T02:21:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:46.039 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-26T02:21:46.046 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T02:21:46.096 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:21:46.110 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:46.234 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:46.363 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:46.398 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-26T02:21:46.406 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:21:46.429 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-26T02:21:46.484 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-26T02:21:46.552 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:21:46.610 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-26T02:21:46.715 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:21:46.853 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:21:46.975 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:21:46.986 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:47.087 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-26T02:21:47.101 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:47.113 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T02:21:47.239 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T02:21:47.243 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:47.334 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T02:21:47.355 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-26T02:21:47.515 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T02:21:47.544 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:47.570 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:47.622 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-26T02:21:47.696 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:47.766 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:21:47.795 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:47.924 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up zip (3.0-12build2) ... 2024-04-26T02:21:47.929 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T02:21:48.025 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-26T02:21:48.106 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:21:48.111 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:21:48.197 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:21:48.315 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:48.358 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T02:21:48.424 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:21:48.458 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T02:21:48.479 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T02:21:48.677 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-26T02:21:48.700 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:48.726 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:48.764 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:21:48.852 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:48.912 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-26T02:21:48.951 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T02:21:49.037 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-26T02:21:49.092 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:21:49.170 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:21:49.171 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-26T02:21:49.203 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:49.218 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:49.328 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:49.344 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:49.478 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:21:49.479 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:21:49.481 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-26T02:21:49.621 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:21:49.780 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T02:21:49.831 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:49.872 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T02:21:49.873 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-26T02:21:49.906 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T02:21:49.948 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:50.066 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T02:21:50.108 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-26T02:21:50.123 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T02:21:50.182 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T02:21:50.343 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:50.358 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:21:50.459 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:21:50.493 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-26T02:21:50.494 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:50.584 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T02:21:50.603 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:50.777 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-26T02:21:50.795 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:21:50.803 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:21:50.803 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:21:50.843 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:21:50.969 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T02:21:51.095 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-26T02:21:51.180 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T02:21:51.253 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:51.263 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:51.338 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-26T02:21:51.379 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:21:51.389 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:51.464 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:51.474 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:21:51.515 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:51.641 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:21:51.680 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:21:51.765 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-idna (3.3-1) ... 2024-04-26T02:21:51.809 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:21:51.927 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:51.973 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:21:52.067 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-26T02:21:52.069 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:52.196 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:21:52.216 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:21:52.342 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:52.468 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:52.532 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:52.557 INFO:teuthology.orchestra.run.smithi136.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T02:21:52.641 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:52.742 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T02:21:52.794 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:52.903 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:52.920 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:53.010 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:53.029 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:53.137 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:53.138 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:53.230 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-26T02:21:53.262 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:53.313 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:21:53.411 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:53.465 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:53.481 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:21:53.481 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:21:53.564 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T02:21:53.599 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:53.608 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-26T02:21:53.674 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T02:21:53.850 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-26T02:21:53.916 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:53.952 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-26T02:21:53.989 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:54.042 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:54.052 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-26T02:21:54.115 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:54.116 INFO:teuthology.orchestra.run.smithi175.stdout:Adding group ceph....done 2024-04-26T02:21:54.241 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:54.320 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-26T02:21:54.342 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:21:54.360 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:21:54.510 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user ceph....done 2024-04-26T02:21:54.580 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-26T02:21:54.652 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:21:54.678 INFO:teuthology.orchestra.run.smithi175.stdout:Setting system user ceph properties....done 2024-04-26T02:21:54.689 INFO:teuthology.orchestra.run.smithi175.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T02:21:54.825 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T02:21:54.831 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:54.928 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T02:21:54.957 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-26T02:21:55.054 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T02:21:55.161 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T02:21:55.258 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-26T02:21:55.314 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T02:21:55.543 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-26T02:21:55.642 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:55.663 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:55.768 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:55.773 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:21:55.788 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:55.802 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-26T02:21:55.914 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:56.040 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:56.061 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T02:21:56.118 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:21:56.158 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:56.211 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:21:56.211 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:21:56.312 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-26T02:21:56.486 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T02:21:56.580 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-26T02:21:56.653 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:56.659 INFO:teuthology.orchestra.run.smithi059.stdout:Adding group ceph....done 2024-04-26T02:21:56.706 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-26T02:21:56.762 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:21:56.952 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user ceph....done 2024-04-26T02:21:56.954 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T02:21:56.999 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-26T02:21:57.112 INFO:teuthology.orchestra.run.smithi059.stdout:Setting system user ceph properties....done 2024-04-26T02:21:57.123 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:21:57.125 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-26T02:21:57.125 INFO:teuthology.orchestra.run.smithi059.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T02:21:57.249 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:57.271 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T02:21:57.375 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:57.405 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:57.418 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-26T02:21:57.518 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:21:57.588 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T02:21:57.627 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:21:57.627 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:21:57.711 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-26T02:21:57.854 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:57.953 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-26T02:21:57.980 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:58.034 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:58.079 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-26T02:21:58.080 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T02:21:58.133 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:58.135 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:58.199 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-26T02:21:58.271 INFO:teuthology.orchestra.run.smithi142.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-26T02:21:58.340 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:58.341 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:21:58.341 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:21:58.467 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:58.509 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-26T02:21:58.591 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:21:58.591 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:21:58.592 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:58.635 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-26T02:21:58.806 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:21:58.807 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:21:58.809 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.028 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-26T02:21:59.053 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.235 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:21:59.236 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:21:59.285 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.287 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-26T02:21:59.411 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.413 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-26T02:21:59.418 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T02:21:59.537 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.671 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:21:59.689 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-26T02:21:59.705 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.807 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.824 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-26T02:21:59.897 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:21:59.958 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:00.118 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:22:00.118 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:22:00.142 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-26T02:22:00.172 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:00.172 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:00.434 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-26T02:22:00.566 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:00.626 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:00.710 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-26T02:22:00.777 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:00.799 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:22:00.799 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:22:00.808 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:00.836 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-26T02:22:00.886 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:00.934 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:01.012 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:01.077 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:01.104 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-26T02:22:01.203 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:01.242 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:01.329 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:01.349 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T02:22:01.405 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-26T02:22:01.441 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T02:22:01.493 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:22:01.494 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:22:01.593 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T02:22:01.758 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-26T02:22:01.813 INFO:teuthology.orchestra.run.smithi136.stdout:Adding group ceph....done 2024-04-26T02:22:01.943 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:02.061 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:02.135 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T02:22:02.139 INFO:teuthology.orchestra.run.smithi136.stdout:Adding system user ceph....done 2024-04-26T02:22:02.212 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:02.308 INFO:teuthology.orchestra.run.smithi136.stdout:Setting system user ceph properties....done 2024-04-26T02:22:02.327 INFO:teuthology.orchestra.run.smithi136.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T02:22:02.411 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-26T02:22:02.430 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:02.430 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:02.462 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T02:22:02.719 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T02:22:02.755 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-26T02:22:02.790 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T02:22:02.874 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librados2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:02.913 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:02.974 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.064 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.084 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-26T02:22:03.199 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.271 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.350 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.380 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.393 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T02:22:03.399 DEBUG:teuthology.parallel:result is None 2024-04-26T02:22:03.420 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.546 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libradosstriper1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.672 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-26T02:22:03.703 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T02:22:03.812 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T02:22:03.829 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:22:03.830 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:22:03.957 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librbd1 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:03.964 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T02:22:04.083 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-modules-core (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:04.192 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:04.307 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:04.390 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:22:04.390 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T02:22:04.654 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T02:22:04.894 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up libcephfs-dev (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:04.994 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rados (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:05.115 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T02:22:05.137 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up librgw2 (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:05.142 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:05.263 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-26T02:22:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:22:05.357 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:22:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T02:22:05.768 DEBUG:teuthology.parallel:result is None 2024-04-26T02:22:05.827 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:06.227 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:22:06.227 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:22:06.442 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rbd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:06.568 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up rbd-fuse (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:06.694 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-rgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:06.706 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:06.820 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up python3-cephfs (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:06.946 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-common (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:06.974 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:22:06.974 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:22:07.416 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:07.438 INFO:teuthology.orchestra.run.smithi142.stdout:Adding group ceph....done 2024-04-26T02:22:07.541 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:07.684 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:07.894 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:07.894 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:08.157 INFO:teuthology.orchestra.run.smithi142.stdout:Adding system user ceph....done 2024-04-26T02:22:08.309 INFO:teuthology.orchestra.run.smithi142.stdout:Setting system user ceph properties....done 2024-04-26T02:22:08.323 INFO:teuthology.orchestra.run.smithi142.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T02:22:08.385 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:08.458 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T02:22:08.528 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:08.645 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:08.780 INFO:teuthology.orchestra.run.smithi136.stdout:Setting up ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:08.790 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T02:22:09.116 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T02:22:09.225 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T02:22:09.255 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-test (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:09.373 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up radosgw (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:09.377 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T02:22:09.794 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:22:09.794 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T02:22:10.241 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-base (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:10.452 INFO:teuthology.orchestra.run.smithi136.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T02:22:10.573 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T02:22:11.026 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mds (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:11.103 INFO:teuthology.orchestra.run.smithi136.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T02:22:11.108 DEBUG:teuthology.parallel:result is None 2024-04-26T02:22:11.253 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:22:11.253 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T02:22:11.720 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:11.932 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:22:11.932 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T02:22:12.380 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-osd (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:12.664 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:22:12.664 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T02:22:13.131 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:13.410 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:13.561 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mon (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:13.775 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:13.775 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T02:22:14.287 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-cephadm (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:14.430 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:14.530 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-mgr-dashboard (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:14.665 INFO:teuthology.orchestra.run.smithi142.stdout:Setting up ceph-volume (19.0.0-2457-gddeaa917-1jammy) ... 2024-04-26T02:22:15.143 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-26T02:22:15.244 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-26T02:22:15.396 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-26T02:22:16.605 INFO:teuthology.orchestra.run.smithi142.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-26T02:22:17.232 INFO:teuthology.orchestra.run.smithi142.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T02:22:17.237 DEBUG:teuthology.parallel:result is None 2024-04-26T02:22:17.237 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:22:17.383 DEBUG:teuthology.orchestra.run.smithi059:> dpkg-query -W -f '${Version}' ceph 2024-04-26T02:22:17.403 INFO:teuthology.orchestra.run.smithi059.stdout:19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:17.404 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:17.404 INFO:teuthology.task.install:The correct ceph version 19.0.0-2457-gddeaa917-1jammy is installed. 2024-04-26T02:22:17.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:22:17.714 DEBUG:teuthology.orchestra.run.smithi136:> dpkg-query -W -f '${Version}' ceph 2024-04-26T02:22:17.734 INFO:teuthology.orchestra.run.smithi136.stdout:19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:17.734 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:17.734 INFO:teuthology.task.install:The correct ceph version 19.0.0-2457-gddeaa917-1jammy is installed. 2024-04-26T02:22:17.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:22:17.878 DEBUG:teuthology.orchestra.run.smithi142:> dpkg-query -W -f '${Version}' ceph 2024-04-26T02:22:17.899 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:17.900 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:17.900 INFO:teuthology.task.install:The correct ceph version 19.0.0-2457-gddeaa917-1jammy is installed. 2024-04-26T02:22:17.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ddeaa91797339a19172c3036ff48cca58c12f448 2024-04-26T02:22:18.148 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-query -W -f '${Version}' ceph 2024-04-26T02:22:18.168 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:18.168 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2457-gddeaa917-1jammy 2024-04-26T02:22:18.168 INFO:teuthology.task.install:The correct ceph version 19.0.0-2457-gddeaa917-1jammy is installed. 2024-04-26T02:22:18.170 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T02:22:18.171 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:18.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T02:22:18.186 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:22:18.186 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T02:22:18.201 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:22:18.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T02:22:18.215 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:22:18.215 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T02:22:18.230 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T02:22:18.230 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:18.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T02:22:18.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T02:22:18.298 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:22:18.298 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T02:22:18.312 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T02:22:18.367 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:22:18.367 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T02:22:18.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T02:22:18.437 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:22:18.437 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T02:22:18.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T02:22:18.504 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T02:22:18.505 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:18.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T02:22:18.519 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T02:22:18.577 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:22:18.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T02:22:18.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T02:22:18.648 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:22:18.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T02:22:18.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T02:22:18.718 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:22:18.718 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T02:22:18.733 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T02:22:18.785 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T02:22:18.785 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:18.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T02:22:18.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T02:22:18.854 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:22:18.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T02:22:18.867 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T02:22:18.924 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:22:18.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T02:22:18.938 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T02:22:18.992 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:22:18.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T02:22:19.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T02:22:19.061 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T02:22:19.152 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T02:22:19.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-04-26T02:22:19.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-04-26T02:22:19.157 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-04-26T02:22:19.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-04-26T02:22:19.172 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T02:22:19.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T02:22:19.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T02:22:19.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T02:22:19.216 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T02:22:19.228 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T02:22:19.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T02:22:19.267 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T02:22:19.273 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T02:22:19.275 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T02:22:19.301 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T02:22:19.301 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T02:22:19.301 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287', 'branch': 'wip-yuri2-testing-2024-04-24-0914-squid', 'description': 'rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7674287', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2024-04-24-0914-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-04-24-0914-squid', 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 1848, 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri2-testing-2024-04-24-0914-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_ddeaa91797339a19172c3036ff48cca58c12f448/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448', 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBSsQGKQvhqYS2w3S+QMQHzTXmOuby59U4v80ULUXSEe3VlZIXjn0DnApzJ5Z3iwd2QLxlwyne3k3Q3q6hlifUc=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMP6+e7e/LOM9jybaRjlOKrFC03d418pRbBFqcfN6YVLe++zo1vYxjkMpGyq3hX6akzerpG3WQck+uQgH8Rd2xE=', 'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDDdarR2RZ6hFOHsedtJBTWBBBdGTvZNAJkb9YaVx35Zb4mOX0PxS0zRlvGUwJOzlBdkVUc7JCz+5IepVMoFPSE=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIlpZWcgP7DwBGkkokV/DqahLDEpq1ngMsV1NQu6//QNR4z0gqY386my9L7XkGWOKucsu5AF/EtKy+G2ZkziBus='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448', 'cluster': 'ceph'}}, {'thrashosds': {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200}}, {'rados': {'clients': ['client.0'], 'ec_pool': True, 'erasure_code_profile': {'c': 2, 'crush-failure-domain': 'osd', 'k': 4, 'm': 3, 'name': 'shecprofile', 'plugin': 'shec'}, 'objects': 50, 'op_weights': {'append': 100, 'copy_from': 50, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 50, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 0}, 'ops': 400, 'write_append_excl': False}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_01:23:56', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T02:22:19.302 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T02:22:19.323 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T02:22:19.330 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T02:22:19.333 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T02:22:19.339 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T02:22:19.371 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T02:22:19.377 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T02:22:19.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T02:22:19.396 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:19.396 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T02:22:19.430 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T02:22:19.430 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 873 Links: 1 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-26 02:16:42.078550598 +0000 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-26 02:16:41.822552874 +0000 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-26 02:16:41.822552874 +0000 2024-04-26T02:22:19.483 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-04-26T02:22:19.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T02:22:19.537 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-26T02:22:19.537 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-26T02:22:19.537 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000398679 s, 1.3 MB/s 2024-04-26T02:22:19.538 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T02:22:19.587 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-04-26T02:22:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T02:22:19.638 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:19.639 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-04-26T02:22:19.639 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:19.639 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-26 02:16:42.570546225 +0000 2024-04-26T02:22:19.639 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-26 02:16:42.306548572 +0000 2024-04-26T02:22:19.639 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-26 02:16:42.306548572 +0000 2024-04-26T02:22:19.639 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-04-26T02:22:19.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T02:22:19.693 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-26T02:22:19.693 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-26T02:22:19.693 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000417208 s, 1.2 MB/s 2024-04-26T02:22:19.694 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T02:22:19.743 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-04-26T02:22:19.790 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T02:22:19.790 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:19.790 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-04-26T02:22:19.791 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:19.791 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-26 02:16:43.046541993 +0000 2024-04-26T02:22:19.791 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-26 02:16:42.806544127 +0000 2024-04-26T02:22:19.791 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-26 02:16:42.806544127 +0000 2024-04-26T02:22:19.791 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-04-26T02:22:19.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T02:22:19.845 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-26T02:22:19.845 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-26T02:22:19.845 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000409874 s, 1.2 MB/s 2024-04-26T02:22:19.846 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T02:22:19.895 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-04-26T02:22:19.947 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T02:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-04-26T02:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-26 02:16:43.526537727 +0000 2024-04-26T02:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-26 02:16:43.270540003 +0000 2024-04-26T02:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-26 02:16:43.270540003 +0000 2024-04-26T02:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2024-04-26T02:22:19.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T02:22:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-26T02:22:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-26T02:22:20.002 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000398487 s, 1.3 MB/s 2024-04-26T02:22:20.003 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T02:22:20.052 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:20.052 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:22:20.052 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T02:22:20.058 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T02:22:20.058 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-04-26T02:22:20.104 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T02:22:20.105 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:20.105 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-04-26T02:22:20.105 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:20.105 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 02:16:36.052600277 +0000 2024-04-26T02:22:20.105 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 02:16:35.812602420 +0000 2024-04-26T02:22:20.105 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 02:16:35.812602420 +0000 2024-04-26T02:22:20.105 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T02:22:20.105 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T02:22:20.158 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T02:22:20.159 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T02:22:20.159 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000391124 s, 1.3 MB/s 2024-04-26T02:22:20.160 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T02:22:20.209 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 02:16:36.576595597 +0000 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 02:16:36.304598026 +0000 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 02:16:36.304598026 +0000 2024-04-26T02:22:20.256 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T02:22:20.257 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T02:22:20.310 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T02:22:20.310 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T02:22:20.310 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000376057 s, 1.4 MB/s 2024-04-26T02:22:20.311 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T02:22:20.361 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-04-26T02:22:20.407 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T02:22:20.408 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:20.408 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 913 Links: 1 2024-04-26T02:22:20.408 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:20.408 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 02:16:37.048591381 +0000 2024-04-26T02:22:20.408 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 02:16:36.804593559 +0000 2024-04-26T02:22:20.408 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 02:16:36.804593559 +0000 2024-04-26T02:22:20.408 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T02:22:20.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T02:22:20.464 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T02:22:20.464 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T02:22:20.464 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000300929 s, 1.7 MB/s 2024-04-26T02:22:20.465 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T02:22:20.513 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-26 02:16:37.532587057 +0000 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-26 02:16:37.280589309 +0000 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-26 02:16:37.280589309 +0000 2024-04-26T02:22:20.560 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-04-26T02:22:20.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T02:22:20.614 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-26T02:22:20.614 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-26T02:22:20.614 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000322252 s, 1.6 MB/s 2024-04-26T02:22:20.615 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T02:22:20.665 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:20.665 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:22:20.666 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T02:22:20.671 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T02:22:20.672 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 868 Links: 1 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 02:16:36.114725243 +0000 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 02:16:35.842727673 +0000 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 02:16:35.842727673 +0000 2024-04-26T02:22:20.718 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T02:22:20.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T02:22:20.772 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T02:22:20.772 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T02:22:20.772 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.00043411 s, 1.2 MB/s 2024-04-26T02:22:20.773 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T02:22:20.823 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-04-26T02:22:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T02:22:20.873 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:20.874 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-04-26T02:22:20.874 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:20.874 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 02:16:36.610720812 +0000 2024-04-26T02:22:20.874 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 02:16:36.366722993 +0000 2024-04-26T02:22:20.874 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 02:16:36.366722993 +0000 2024-04-26T02:22:20.874 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T02:22:20.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T02:22:20.927 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T02:22:20.927 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T02:22:20.927 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000335033 s, 1.5 MB/s 2024-04-26T02:22:20.928 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T02:22:20.978 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-04-26T02:22:21.025 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T02:22:21.025 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:21.025 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-04-26T02:22:21.025 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:21.025 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 02:16:37.138716097 +0000 2024-04-26T02:22:21.025 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 02:16:36.842718741 +0000 2024-04-26T02:22:21.025 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 02:16:36.842718741 +0000 2024-04-26T02:22:21.026 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T02:22:21.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T02:22:21.080 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T02:22:21.080 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T02:22:21.080 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000439133 s, 1.2 MB/s 2024-04-26T02:22:21.081 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T02:22:21.131 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-26 02:16:37.650711524 +0000 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-26 02:16:37.390713846 +0000 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-26 02:16:37.390713846 +0000 2024-04-26T02:22:21.178 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2024-04-26T02:22:21.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T02:22:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-26T02:22:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-26T02:22:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000397133 s, 1.3 MB/s 2024-04-26T02:22:21.232 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T02:22:21.282 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:21.282 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:22:21.283 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T02:22:21.289 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T02:22:21.289 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-26T02:22:21.338 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T02:22:21.339 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:21.339 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-04-26T02:22:21.339 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:21.339 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 02:16:38.486764085 +0000 2024-04-26T02:22:21.339 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 02:16:38.482764121 +0000 2024-04-26T02:22:21.339 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 02:16:38.482764121 +0000 2024-04-26T02:22:21.339 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T02:22:21.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T02:22:21.397 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T02:22:21.397 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T02:22:21.397 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000402624 s, 1.3 MB/s 2024-04-26T02:22:21.398 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T02:22:21.447 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 02:16:39.158758083 +0000 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 02:16:38.918760227 +0000 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 02:16:38.918760227 +0000 2024-04-26T02:22:21.494 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T02:22:21.495 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T02:22:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T02:22:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T02:22:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00036517 s, 1.4 MB/s 2024-04-26T02:22:21.549 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T02:22:21.601 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 02:16:39.622753939 +0000 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 02:16:39.402755904 +0000 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 02:16:39.402755904 +0000 2024-04-26T02:22:21.650 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T02:22:21.651 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T02:22:21.704 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T02:22:21.704 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T02:22:21.704 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000337674 s, 1.5 MB/s 2024-04-26T02:22:21.705 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T02:22:21.755 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-26T02:22:21.802 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T02:22:21.802 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T02:22:21.802 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-26T02:22:21.802 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T02:22:21.802 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-26 02:16:40.146749258 +0000 2024-04-26T02:22:21.802 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-26 02:16:39.870751724 +0000 2024-04-26T02:22:21.802 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-26 02:16:39.870751724 +0000 2024-04-26T02:22:21.803 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: - 2024-04-26T02:22:21.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T02:22:21.856 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-26T02:22:21.856 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-26T02:22:21.856 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000380666 s, 1.3 MB/s 2024-04-26T02:22:21.857 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T02:22:21.908 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:21.908 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-04-26T02:22:21.908 INFO:tasks.ceph:Generating config... 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T02:22:21.910 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.1 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-04-26T02:22:21.911 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-04-26T02:22:21.912 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-04-26T02:22:21.912 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T02:22:21.912 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-04-26T02:22:21.912 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-04-26T02:22:21.912 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-04-26T02:22:21.912 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-04-26T02:22:21.912 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-26T02:22:21.912 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-04-26T02:22:21.912 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-04-26T02:22:21.912 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2024-04-26T02:22:21.912 INFO:tasks.ceph:[global] ms tcp read timeout = 5 2024-04-26T02:22:21.912 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T02:22:21.913 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T02:22:21.913 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T02:22:21.913 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T02:22:21.913 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T02:22:21.913 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-04-26T02:22:21.913 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T02:22:21.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T02:22:21.949 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T02:22:21.965 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T02:22:22.041 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T02:22:22.099 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '172.21.15.136'), ('mon.c', '172.21.15.142')] 2024-04-26T02:22:22.099 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,172.21.15.136,172.21.15.142', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2024-04-26T02:22:22.100 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:22.100 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T02:22:22.146 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --add b 172.21.15.136 --add c 172.21.15.142 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid 83ecef7b-067c-41a4-8f83-dfa16b8b2690 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 83ecef7b-067c-41a4-8f83-dfa16b8b2690 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2024-04-26T02:22:22.236327+0000 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-04-26T02:22:22.236327+0000 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 17 (quincy) 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 3 2024-04-26T02:22:22.234 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-04-26T02:22:22.235 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-04-26T02:22:22.235 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.c 2024-04-26T02:22:22.235 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T02:22:22.236 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T02:22:22.241 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 83ecef7b-067c-41a4-8f83-dfa16b8b2690... 2024-04-26T02:22:22.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T02:22:22.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T02:22:22.289 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T02:22:22.292 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T02:22:22.313 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-04-26T02:22:22.313 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-04-26T02:22:22.313 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T02:22:22.313 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-04-26T02:22:22.313 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T02:22:22.314 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-04-26T02:22:22.315 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-04-26T02:22:22.316 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.136,172.21.15.142" 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: mon client directed command retry = 5 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: mon election default strategy = 3 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: ms inject socket failures = 2500 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: ms tcp read timeout = 5 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 83ecef7b-067c-41a4-8f83-dfa16b8b2690 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 120 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-04-26T02:22:22.317 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.318 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: debug monc = 20 2024-04-26T02:22:22.319 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore zero block detection = True 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-04-26T02:22:22.320 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd blocked scrub grace period = 3600 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug reject backfill probability = 0.1 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify cached snaps = True 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify missing on start = True 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd max backfills = 3 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd max markdown count = 1000 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock override recovery settings = True 2024-04-26T02:22:22.321 INFO:teuthology.orchestra.run.smithi059.stdout: osd memory target = 1610612736 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: osd op queue = debug_random 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: osd op queue cut off = debug_random 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub min interval = 60 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: osd shutdown pgref assert = True 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.322 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.323 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: mon scrub interval = 300 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-04-26T02:22:22.324 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-04-26T02:22:22.325 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-04-26T02:22:22.325 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-04-26T02:22:22.325 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T02:22:22.325 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T02:22:22.325 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-04-26T02:22:22.325 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-04-26T02:22:22.325 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-04-26T02:22:22.326 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-26T02:22:22.326 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-26T02:22:22.326 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T02:22:22.326 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-26T02:22:22.326 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.326 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-26T02:22:22.326 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.327 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-26T02:22:22.327 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.327 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-26T02:22:22.327 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-26T02:22:22.327 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.327 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T02:22:22.328 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T02:22:22.329 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-26T02:22:22.330 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.59,172.21.15.136,172.21.15.142" 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: mon client directed command retry = 5 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: mon election default strategy = 3 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject socket failures = 2500 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: ms tcp read timeout = 5 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 83ecef7b-067c-41a4-8f83-dfa16b8b2690 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.331 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 120 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-26T02:22:22.332 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.333 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: debug monc = 20 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore zero block detection = True 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 20 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 20 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 10 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T02:22:22.334 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd blocked scrub grace period = 3600 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug reject backfill probability = 0.1 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify cached snaps = True 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify missing on start = True 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd max backfills = 3 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd max markdown count = 1000 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock override recovery settings = True 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd memory target = 1610612736 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd op queue = debug_random 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd op queue cut off = debug_random 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub min interval = 60 2024-04-26T02:22:22.335 INFO:teuthology.orchestra.run.smithi175.stdout: osd shutdown pgref assert = True 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-26T02:22:22.336 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-26T02:22:22.337 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-26T02:22:22.337 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-26T02:22:22.337 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-26T02:22:22.337 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.337 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-26T02:22:22.337 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-26T02:22:22.338 INFO:teuthology.orchestra.run.smithi175.stdout: mon scrub interval = 300 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-26T02:22:22.339 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-04-26T02:22:22.340 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-04-26T02:22:22.341 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.341 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T02:22:22.341 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-04-26T02:22:22.341 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.341 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T02:22:22.341 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T02:22:22.341 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T02:22:22.342 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.59,172.21.15.136,172.21.15.142" 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: mon client directed command retry = 5 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: mon election default strategy = 3 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: ms inject socket failures = 2500 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: ms tcp read timeout = 5 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 83ecef7b-067c-41a4-8f83-dfa16b8b2690 2024-04-26T02:22:22.343 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 120 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-04-26T02:22:22.344 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug trim objects = true 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.345 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: debug monc = 20 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: bdev async discard = True 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: bdev enable discard = True 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore zero block detection = True 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2024-04-26T02:22:22.346 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd blocked scrub grace period = 3600 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug reject backfill probability = 0.1 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify cached snaps = True 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify missing on start = True 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd max backfills = 3 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd max markdown count = 1000 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock override recovery settings = True 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd memory target = 1610612736 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd op queue = debug_random 2024-04-26T02:22:22.347 INFO:teuthology.orchestra.run.smithi136.stdout: osd op queue cut off = debug_random 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub min interval = 60 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: osd shutdown pgref assert = True 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.348 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T02:22:22.349 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: mon scrub interval = 300 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-04-26T02:22:22.350 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-04-26T02:22:22.351 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-04-26T02:22:22.352 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T02:22:22.352 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-04-26T02:22:22.352 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.352 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-04-26T02:22:22.352 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.352 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-04-26T02:22:22.353 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.353 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-04-26T02:22:22.353 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-04-26T02:22:22.353 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.353 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-04-26T02:22:22.353 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-04-26T02:22:22.353 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-04-26T02:22:22.354 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-04-26T02:22:22.355 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.59,172.21.15.136,172.21.15.142" 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: mon client directed command retry = 5 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: mon election default strategy = 3 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject socket failures = 2500 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: ms tcp read timeout = 5 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 83ecef7b-067c-41a4-8f83-dfa16b8b2690 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 120 2024-04-26T02:22:22.356 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-04-26T02:22:22.357 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: debug monc = 20 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-04-26T02:22:22.358 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore zero block detection = True 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: osd blocked scrub grace period = 3600 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug reject backfill probability = 0.1 2024-04-26T02:22:22.359 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify cached snaps = True 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify missing on start = True 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd max backfills = 3 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd max markdown count = 1000 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock override recovery settings = True 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd memory target = 1610612736 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd op queue = debug_random 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd op queue cut off = debug_random 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub min interval = 60 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: osd shutdown pgref assert = True 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-04-26T02:22:22.360 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-04-26T02:22:22.361 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T02:22:22.362 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: mon scrub interval = 300 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T02:22:22.363 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-04-26T02:22:22.364 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2024-04-26T02:22:22.364 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2024-04-26T02:22:22.366 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T02:22:22.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T02:22:22.459 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T02:22:22.459 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:22.459 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T02:22:22.465 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:22.465 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T02:22:22.510 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:22:22.510 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:22.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T02:22:22.511 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T02:22:22.576 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:22:22.576 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:22.622 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:22:22.623 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:22:22.623 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T02:22:22.628 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T02:22:22.652 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:22:22.652 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:22.700 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:22:22.700 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:22:22.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T02:22:22.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T02:22:22.724 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:22:22.724 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:22.773 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:22:22.774 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:22:22.774 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T02:22:22.774 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T02:22:22.797 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:22:22.797 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:22.846 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T02:22:22.846 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T02:22:22.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T02:22:22.892 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T02:22:22.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T02:22:22.937 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T02:22:22.948 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T02:22:22.949 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T02:22:22.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T02:22:23.022 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T02:22:23.033 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T02:22:23.033 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2024-04-26T02:22:23.033 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T02:22:23.048 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:23.048 INFO:tasks.ceph:role: osd.0 2024-04-26T02:22:23.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:22:23.048 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T02:22:23.112 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:23.112 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:23.112 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:23.112 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:23.112 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:23.112 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:23.113 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:23.113 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:23.113 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:23.113 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:23.564 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-26T02:22:23.566 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-26T02:22:23.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T02:22:23.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T02:22:23.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:23.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T02:22:23.750 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:23.750 INFO:tasks.ceph:role: osd.4 2024-04-26T02:22:23.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:22:23.750 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T02:22:23.814 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:23.814 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:23.814 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:23.815 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:23.815 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:23.815 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:24.268 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-26T02:22:24.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-26T02:22:24.270 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-04-26T02:22:24.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T02:22:24.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:24.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-04-26T02:22:24.470 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:24.470 INFO:tasks.ceph:role: osd.8 2024-04-26T02:22:24.471 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:22:24.471 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T02:22:24.533 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:24.533 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:24.533 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:24.533 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:24.533 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:24.533 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:24.533 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:24.534 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:24.534 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:24.534 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:25.010 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-26T02:22:25.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-26T02:22:25.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-04-26T02:22:25.165 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-04-26T02:22:25.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:25.178 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:25.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2024-04-26T02:22:25.234 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:25.234 INFO:tasks.ceph:role: osd.12 2024-04-26T02:22:25.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:22:25.234 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T02:22:25.298 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:25.298 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:25.298 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:25.299 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:25.299 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:25.299 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:25.299 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:25.299 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:25.299 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:25.299 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:25.724 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-26T02:22:25.726 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-26T02:22:25.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2024-04-26T02:22:25.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2024-04-26T02:22:25.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:25.837 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:25.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:25.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:25.951+0000 7fa83d4607c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T02:22:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:25.955+0000 7fa83d4607c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T02:22:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:25.955+0000 7fa83d4607c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T02:22:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:25.955+0000 7fa83d4607c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T02:22:25.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:25.955+0000 7fa83d4607c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T02:22:25.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:25.959+0000 7fa83d4607c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T02:22:28.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T02:22:28.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:29.051+0000 7f24273537c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T02:22:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:29.051+0000 7f24273537c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T02:22:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:29.051+0000 7f24273537c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T02:22:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:29.051+0000 7f24273537c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T02:22:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:29.051+0000 7f24273537c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T02:22:29.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:29.051+0000 7f24273537c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T02:22:32.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T02:22:32.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:32.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:32.159+0000 7f1bdb28e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-04-26T02:22:32.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:32.159+0000 7f1bdb28e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-04-26T02:22:32.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:32.159+0000 7f1bdb28e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-04-26T02:22:32.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:32.159+0000 7f1bdb28e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-04-26T02:22:32.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:32.159+0000 7f1bdb28e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-04-26T02:22:32.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:32.163+0000 7f1bdb28e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-04-26T02:22:35.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-04-26T02:22:35.200 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:35.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:35.283+0000 7fb9cea147c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2024-04-26T02:22:35.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:35.283+0000 7fb9cea147c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2024-04-26T02:22:35.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:35.283+0000 7fb9cea147c0 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-04-26T02:22:35.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:35.283+0000 7fb9cea147c0 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-04-26T02:22:35.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:35.283+0000 7fb9cea147c0 -1 bluestore(/var/lib/ceph/osd/ceph-12/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-12/block: (2) No such file or directory 2024-04-26T02:22:35.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:22:35.283+0000 7fb9cea147c0 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2024-04-26T02:22:38.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2024-04-26T02:22:38.311 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T02:22:38.325 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:38.325 INFO:tasks.ceph:role: osd.1 2024-04-26T02:22:38.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:22:38.325 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T02:22:38.387 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:38.387 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:38.387 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:38.387 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:38.387 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:38.387 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:38.387 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:38.388 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:38.388 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:38.388 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:38.892 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-26T02:22:38.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-26T02:22:38.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T02:22:38.991 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T02:22:39.001 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:39.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:39.002 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T02:22:39.055 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:39.055 INFO:tasks.ceph:role: osd.5 2024-04-26T02:22:39.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:22:39.055 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:39.121 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:39.635 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-26T02:22:39.636 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-26T02:22:39.637 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T02:22:39.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T02:22:39.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:39.770 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:39.771 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-04-26T02:22:39.825 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:39.826 INFO:tasks.ceph:role: osd.9 2024-04-26T02:22:39.826 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:22:39.826 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T02:22:39.887 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:39.887 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:39.887 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:39.887 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:39.888 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:39.888 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:39.888 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:39.888 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:39.888 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:39.888 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:40.381 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-26T02:22:40.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-26T02:22:40.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2024-04-26T02:22:40.491 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-04-26T02:22:40.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:40.503 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:40.503 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2024-04-26T02:22:40.559 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:40.559 INFO:tasks.ceph:role: osd.13 2024-04-26T02:22:40.559 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:22:40.560 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T02:22:40.623 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:40.624 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:41.128 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-26T02:22:41.130 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-26T02:22:41.130 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2024-04-26T02:22:41.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2024-04-26T02:22:41.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:41.247 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:41.247 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:41.359 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:41.353+0000 7fddd8f867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T02:22:41.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:41.361+0000 7fddd8f867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T02:22:41.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:41.361+0000 7fddd8f867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T02:22:41.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:41.361+0000 7fddd8f867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T02:22:41.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:41.361+0000 7fddd8f867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T02:22:41.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:41.361+0000 7fddd8f867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T02:22:44.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T02:22:44.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:44.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:44.429+0000 7f029cf857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T02:22:44.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:44.429+0000 7f029cf857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T02:22:44.433 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:44.429+0000 7f029cf857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T02:22:44.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:44.429+0000 7f029cf857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T02:22:44.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:44.429+0000 7f029cf857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T02:22:44.434 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:44.429+0000 7f029cf857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T02:22:47.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T02:22:47.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:47.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:47.545+0000 7fc34ff8a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-04-26T02:22:47.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:47.545+0000 7fc34ff8a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-04-26T02:22:47.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:47.545+0000 7fc34ff8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-04-26T02:22:47.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:47.545+0000 7fc34ff8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-04-26T02:22:47.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:47.545+0000 7fc34ff8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-04-26T02:22:47.550 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:47.545+0000 7fc34ff8a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-04-26T02:22:50.554 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-04-26T02:22:50.609 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:50.689 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:50.685+0000 7fae204c57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2024-04-26T02:22:50.690 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:50.685+0000 7fae204c57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2024-04-26T02:22:50.690 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:50.685+0000 7fae204c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-04-26T02:22:50.690 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:50.685+0000 7fae204c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-04-26T02:22:50.690 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:50.685+0000 7fae204c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-13/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-13/block: (2) No such file or directory 2024-04-26T02:22:50.690 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-26T02:22:50.685+0000 7fae204c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2024-04-26T02:22:53.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2024-04-26T02:22:53.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T02:22:53.767 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:53.767 INFO:tasks.ceph:role: osd.2 2024-04-26T02:22:53.767 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:22:53.767 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T02:22:53.829 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:53.829 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:53.829 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:53.829 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:53.829 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:53.829 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:53.829 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:53.830 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:53.830 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:53.830 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:54.311 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-26T02:22:54.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-26T02:22:54.313 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T02:22:54.477 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T02:22:54.488 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:54.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:54.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T02:22:54.544 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:54.544 INFO:tasks.ceph:role: osd.6 2024-04-26T02:22:54.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:22:54.544 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T02:22:54.608 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:54.608 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:54.608 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:54.608 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:54.609 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:54.609 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:54.609 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:54.609 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:54.609 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:54.609 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:55.065 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-26T02:22:55.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-26T02:22:55.068 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2024-04-26T02:22:55.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T02:22:55.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:55.170 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:55.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-04-26T02:22:55.222 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:55.222 INFO:tasks.ceph:role: osd.10 2024-04-26T02:22:55.223 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:22:55.223 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:55.284 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:55.746 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-26T02:22:55.748 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-26T02:22:55.748 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2024-04-26T02:22:55.859 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-04-26T02:22:55.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:55.869 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:55.869 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2024-04-26T02:22:55.923 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2024-04-26T02:22:55.923 INFO:tasks.ceph:role: osd.14 2024-04-26T02:22:55.923 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:22:55.923 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:22:55.986 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:22:56.480 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-26T02:22:56.483 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-26T02:22:56.483 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2024-04-26T02:22:56.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2024-04-26T02:22:56.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:22:56.646 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:22:56.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:56.764 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:56.758+0000 7f9e67c387c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T02:22:56.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:56.762+0000 7f9e67c387c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T02:22:56.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:56.762+0000 7f9e67c387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T02:22:56.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:56.762+0000 7f9e67c387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T02:22:56.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:56.762+0000 7f9e67c387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T02:22:56.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:56.770+0000 7f9e67c387c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T02:22:59.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T02:22:59.806 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:22:59.886 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:59.882+0000 7fa7f44077c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T02:22:59.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:59.882+0000 7fa7f44077c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T02:22:59.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:59.882+0000 7fa7f44077c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T02:22:59.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:59.882+0000 7fa7f44077c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T02:22:59.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:59.882+0000 7fa7f44077c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T02:22:59.887 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:22:59.882+0000 7fa7f44077c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T02:23:02.867 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T02:23:02.925 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:03.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:03.002+0000 7f4a07e757c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-04-26T02:23:03.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:03.002+0000 7f4a07e757c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-04-26T02:23:03.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:03.002+0000 7f4a07e757c0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-04-26T02:23:03.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:03.002+0000 7f4a07e757c0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-04-26T02:23:03.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:03.002+0000 7f4a07e757c0 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-04-26T02:23:03.007 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:03.002+0000 7f4a07e757c0 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-04-26T02:23:05.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-04-26T02:23:06.033 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:06.110+0000 7f499f7667c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2024-04-26T02:23:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:06.114+0000 7f499f7667c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2024-04-26T02:23:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:06.114+0000 7f499f7667c0 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-04-26T02:23:06.116 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:06.114+0000 7f499f7667c0 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-04-26T02:23:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:06.114+0000 7f499f7667c0 -1 bluestore(/var/lib/ceph/osd/ceph-14/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-14/block: (2) No such file or directory 2024-04-26T02:23:06.117 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-26T02:23:06.114+0000 7f499f7667c0 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2024-04-26T02:23:09.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2024-04-26T02:23:09.162 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T02:23:09.177 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-26T02:23:09.177 INFO:tasks.ceph:role: osd.3 2024-04-26T02:23:09.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:23:09.177 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:23:09.242 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:23:09.712 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T02:23:09.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T02:23:09.714 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-04-26T02:23:09.812 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T02:23:09.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:23:09.825 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:23:09.826 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T02:23:09.881 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-26T02:23:09.881 INFO:tasks.ceph:role: osd.7 2024-04-26T02:23:09.881 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:23:09.881 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:23:09.946 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:23:09.947 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:23:10.410 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T02:23:10.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T02:23:10.412 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2024-04-26T02:23:10.556 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T02:23:10.570 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:23:10.571 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:23:10.571 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-04-26T02:23:10.626 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-26T02:23:10.626 INFO:tasks.ceph:role: osd.11 2024-04-26T02:23:10.626 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:23:10.626 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T02:23:10.689 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:23:10.689 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:23:10.690 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:23:11.162 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T02:23:11.164 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T02:23:11.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2024-04-26T02:23:11.320 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-04-26T02:23:11.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:23:11.332 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:23:11.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2024-04-26T02:23:11.390 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2024-04-26T02:23:11.390 INFO:tasks.ceph:role: osd.15 2024-04-26T02:23:11.391 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:23:11.391 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T02:23:11.455 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T02:23:11.455 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T02:23:11.456 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T02:23:11.883 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-26T02:23:11.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-26T02:23:11.885 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2024-04-26T02:23:11.977 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2024-04-26T02:23:11.987 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T02:23:11.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:23:11.988 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:12.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:12.097+0000 7f282a3a67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T02:23:12.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:12.101+0000 7f282a3a67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T02:23:12.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:12.101+0000 7f282a3a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T02:23:12.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:12.101+0000 7f282a3a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T02:23:12.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:12.101+0000 7f282a3a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T02:23:12.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:12.101+0000 7f282a3a67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T02:23:15.085 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T02:23:15.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:15.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:15.177+0000 7fac08f647c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T02:23:15.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:15.177+0000 7fac08f647c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T02:23:15.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:15.177+0000 7fac08f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T02:23:15.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:15.177+0000 7fac08f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T02:23:15.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:15.177+0000 7fac08f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T02:23:15.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:15.177+0000 7fac08f647c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T02:23:18.153 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T02:23:18.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:18.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:18.289+0000 7fd1bd7387c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-04-26T02:23:18.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:18.289+0000 7fd1bd7387c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-04-26T02:23:18.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:18.289+0000 7fd1bd7387c0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-04-26T02:23:18.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:18.289+0000 7fd1bd7387c0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-04-26T02:23:18.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:18.289+0000 7fd1bd7387c0 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-04-26T02:23:18.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:18.293+0000 7fd1bd7387c0 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-04-26T02:23:21.282 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-04-26T02:23:21.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:21.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:21.417+0000 7f54a254c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2024-04-26T02:23:21.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:21.417+0000 7f54a254c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2024-04-26T02:23:21.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:21.417+0000 7f54a254c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-04-26T02:23:21.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:21.417+0000 7f54a254c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-04-26T02:23:21.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:21.417+0000 7f54a254c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-15/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-15/block: (2) No such file or directory 2024-04-26T02:23:21.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-26T02:23:21.417+0000 7f54a254c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2024-04-26T02:23:24.405 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2024-04-26T02:23:24.461 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T02:23:24.462 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:24.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T02:23:24.477 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:24.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T02:23:24.534 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:24.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T02:23:24.593 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:24.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-04-26T02:23:24.650 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:24.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2024-04-26T02:23:24.706 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:24.706 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T02:23:24.720 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:24.720 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T02:23:24.774 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:24.774 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-04-26T02:23:24.830 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:24.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2024-04-26T02:23:24.887 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:24.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T02:23:24.901 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:24.901 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T02:23:24.956 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:24.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-04-26T02:23:25.011 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:25.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2024-04-26T02:23:25.064 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:25.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T02:23:25.078 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:25.078 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T02:23:25.133 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:25.134 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T02:23:25.189 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:25.189 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-04-26T02:23:25.245 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:25.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2024-04-26T02:23:25.301 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:25.301 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T02:23:25.350 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T02:23:25.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T02:23:25.353 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T02:23:25.356 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDeDytmdGRUNRAAOOelEImhpdWxd2UKUezVVw== 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDhDytmjQDiOBAAAvjLQxmKpn9uV9TRUNDQVQ== 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDlDytm6TQmAxAAvF5UL7jnhDiHVv+xyYO8OQ== 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.8] 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDoDytmUBG+CRAAkmzXmv6H2RBjSxSwwEmp7g== 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.12] 2024-04-26T02:23:25.363 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDrDytm5Wv8EBAACIN431sow+1hthqEXMNzYQ== 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDxDytmAU1mFRAAlLz6Q/3kfEG1qgn1neqfAg== 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD0Dytmg8TPGRAAgGPuLkshiy8XxJP0uCtJaw== 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.9] 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD3Dytmvlq4IBAAiacyEBitZ8SVp6HCUGBLHw== 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.13] 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQD6DytmGlIWKRAAgNjw+gnxgN1sJWsnu1LdjQ== 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAAECtmNNejLRAA4fD7JaMaITc8QwYaLeezeQ== 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQADECtmBC7xNBAAB0JtCqc2mpRoQKDyTS8Y1A== 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.10] 2024-04-26T02:23:25.364 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAHECtmZHN0ABAA8IjUOfxEPSTj9/ME7zyXFQ== 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.14] 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAKECtmveQEBxAA7hkq/VQ+U1AbMk883GrwTw== 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDeDytmxpULOBAAwHnlfCLvGDexiGuRXVQISg== 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAQECtmiig2BhAAZWauFtOY7mn3syDty6XGpA== 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQATECtm09DUChAAYFhUnih2dtsWe/j+aANivQ== 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.11] 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAWECtm3bSYERAAInoHMSyR8TzB+mYAQ2FJWA== 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.15] 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQAZECtmYL0rGRAA/oN7UU7M1RGU7cZkpqdFFQ== 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-26T02:23:25.365 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDfDytmPfJ7ARAAY7sBFVkkZUAvA9U4oxA4iw== 2024-04-26T02:23:25.366 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2024-04-26T02:23:25.366 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDeDytmdGRUNRAAOOelEImhpdWxd2UKUezVVw== 2024-04-26T02:23:25.366 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2024-04-26T02:23:25.366 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDhDytmjQDiOBAAAvjLQxmKpn9uV9TRUNDQVQ== 2024-04-26T02:23:25.366 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2024-04-26T02:23:25.366 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDlDytm6TQmAxAAvF5UL7jnhDiHVv+xyYO8OQ== 2024-04-26T02:23:25.366 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.8] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDoDytmUBG+CRAAkmzXmv6H2RBjSxSwwEmp7g== 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.12] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDrDytm5Wv8EBAACIN431sow+1hthqEXMNzYQ== 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDxDytmAU1mFRAAlLz6Q/3kfEG1qgn1neqfAg== 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD0Dytmg8TPGRAAgGPuLkshiy8XxJP0uCtJaw== 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.9] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD3Dytmvlq4IBAAiacyEBitZ8SVp6HCUGBLHw== 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.13] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQD6DytmGlIWKRAAgNjw+gnxgN1sJWsnu1LdjQ== 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAAECtmNNejLRAA4fD7JaMaITc8QwYaLeezeQ== 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2024-04-26T02:23:25.367 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQADECtmBC7xNBAAB0JtCqc2mpRoQKDyTS8Y1A== 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.10] 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAHECtmZHN0ABAA8IjUOfxEPSTj9/ME7zyXFQ== 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.14] 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAKECtmveQEBxAA7hkq/VQ+U1AbMk883GrwTw== 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDeDytmxpULOBAAwHnlfCLvGDexiGuRXVQISg== 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAQECtmiig2BhAAZWauFtOY7mn3syDty6XGpA== 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQATECtm09DUChAAYFhUnih2dtsWe/j+aANivQ== 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.11] 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAWECtm3bSYERAAInoHMSyR8TzB+mYAQ2FJWA== 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.15] 2024-04-26T02:23:25.368 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQAZECtmYL0rGRAA/oN7UU7M1RGU7cZkpqdFFQ== 2024-04-26T02:23:25.369 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2024-04-26T02:23:25.369 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDfDytmPfJ7ARAAY7sBFVkkZUAvA9U4oxA4iw== 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDeDytmdGRUNRAAOOelEImhpdWxd2UKUezVVw== 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDhDytmjQDiOBAAAvjLQxmKpn9uV9TRUNDQVQ== 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDlDytm6TQmAxAAvF5UL7jnhDiHVv+xyYO8OQ== 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.8] 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDoDytmUBG+CRAAkmzXmv6H2RBjSxSwwEmp7g== 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.12] 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDrDytm5Wv8EBAACIN431sow+1hthqEXMNzYQ== 2024-04-26T02:23:25.371 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDxDytmAU1mFRAAlLz6Q/3kfEG1qgn1neqfAg== 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD0Dytmg8TPGRAAgGPuLkshiy8XxJP0uCtJaw== 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.9] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD3Dytmvlq4IBAAiacyEBitZ8SVp6HCUGBLHw== 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.13] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD6DytmGlIWKRAAgNjw+gnxgN1sJWsnu1LdjQ== 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAAECtmNNejLRAA4fD7JaMaITc8QwYaLeezeQ== 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQADECtmBC7xNBAAB0JtCqc2mpRoQKDyTS8Y1A== 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.10] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAHECtmZHN0ABAA8IjUOfxEPSTj9/ME7zyXFQ== 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.14] 2024-04-26T02:23:25.372 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAKECtmveQEBxAA7hkq/VQ+U1AbMk883GrwTw== 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDeDytmxpULOBAAwHnlfCLvGDexiGuRXVQISg== 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAQECtmiig2BhAAZWauFtOY7mn3syDty6XGpA== 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQATECtm09DUChAAYFhUnih2dtsWe/j+aANivQ== 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.11] 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAWECtm3bSYERAAInoHMSyR8TzB+mYAQ2FJWA== 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.15] 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAZECtmYL0rGRAA/oN7UU7M1RGU7cZkpqdFFQ== 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-04-26T02:23:25.373 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQDfDytmPfJ7ARAAY7sBFVkkZUAvA9U4oxA4iw== 2024-04-26T02:23:25.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T02:23:25.419 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T02:23:25.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T02:23:25.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.471 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.563 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.648 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.680 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.731 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.764 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.805 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.807 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.896 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.928 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:25.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.008 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.143 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.180 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.228 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.260 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.310 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.344 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T02:23:26.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T02:23:26.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T02:23:26.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.561 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.647 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.731 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.815 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.818 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T02:23:26.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T02:23:26.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T02:23:26.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T02:23:26.950 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T02:23:26.950 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T02:23:26.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T02:23:27.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T02:23:27.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T02:23:27.076 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T02:23:27.170 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T02:23:27.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T02:23:27.196 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T02:23:27.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T02:23:27.302 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:27.304 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:27.306 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T02:23:27.348 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T02:23:27.349 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T02:23:27.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T02:23:27.354 INFO:tasks.ceph.mon.a:Started 2024-04-26T02:23:27.354 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T02:23:27.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T02:23:27.357 INFO:tasks.ceph.mon.b:Started 2024-04-26T02:23:27.358 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T02:23:27.358 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T02:23:27.394 INFO:tasks.ceph.mon.c:Started 2024-04-26T02:23:27.394 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T02:23:27.394 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T02:23:27.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T02:23:27.398 INFO:tasks.ceph.mgr.y:Started 2024-04-26T02:23:27.399 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T02:23:27.399 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T02:23:27.401 INFO:tasks.ceph.mgr.x:Started 2024-04-26T02:23:27.401 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T02:23:27.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T02:23:34.048 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-04-26T02:23:34.068 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T02:23:34.068 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T02:23:34.068 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:34.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T02:23:34.080 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:34.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T02:23:34.132 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:34.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-04-26T02:23:34.153 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:34.150+0000 7f4af7bf0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T02:23:34.164 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-26T02:23:34.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2024-04-26T02:23:34.217 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:34.217 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T02:23:34.231 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:34.232 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T02:23:34.288 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:34.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-04-26T02:23:34.342 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-26T02:23:34.342 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2024-04-26T02:23:34.399 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:34.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T02:23:34.415 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:34.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T02:23:34.469 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:34.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-04-26T02:23:34.525 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-26T02:23:34.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2024-04-26T02:23:34.530 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:34.529+0000 7f3d8ff3b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T02:23:34.580 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:34.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T02:23:34.596 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:34.596 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T02:23:34.649 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:34.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-04-26T02:23:34.667 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:34.666+0000 7f4af7bf0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T02:23:34.705 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-26T02:23:34.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2024-04-26T02:23:34.761 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 393355f7-165c-4b50-a42c-211810b715e4 0 2024-04-26T02:23:34.877 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:34.874+0000 7f4af7bf0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T02:23:35.039 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-04-26T02:23:35.058 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new b2c35012-83a0-41ad-af28-9b6c78c491e6 1 2024-04-26T02:23:35.072 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:35.068+0000 7f3d8ff3b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T02:23:35.291 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-26T02:23:35.313 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 5d88e67c-1ca1-4660-9cab-a609fce99a51 2 2024-04-26T02:23:35.316 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:35.312+0000 7f3d8ff3b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T02:23:35.452 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.450+0000 7f4af7bf0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T02:23:35.509 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.506+0000 7f4af7bf0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T02:23:35.521 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-04-26T02:23:35.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 47b1c97a-90b1-4cf5-ad48-2a413f2469bd 3 2024-04-26T02:23:35.564 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.562+0000 7f4af7bf0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T02:23:35.645 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.642+0000 7f4af7bf0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T02:23:35.700 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.698+0000 7f4af7bf0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T02:23:35.737 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-04-26T02:23:35.754 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new ae142bca-645a-48c1-ab55-d439ba3354e9 4 2024-04-26T02:23:35.781 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.778+0000 7f4af7bf0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T02:23:35.838 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.834+0000 7f4af7bf0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T02:23:35.884 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:35.880+0000 7f3d8ff3b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T02:23:35.939 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:35.936+0000 7f3d8ff3b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T02:23:35.964 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-04-26T02:23:35.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new a1842799-b72b-4931-a839-253ac1b292d8 5 2024-04-26T02:23:35.994 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:35.994+0000 7f4af7bf0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T02:23:35.995 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:35.992+0000 7f3d8ff3b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T02:23:36.059 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:36.058+0000 7f4af7bf0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T02:23:36.074 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:36.072+0000 7f3d8ff3b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T02:23:36.128 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:36.124+0000 7f3d8ff3b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T02:23:36.178 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-04-26T02:23:36.195 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8281f789-0853-4359-8aaa-c9ec5795fd51 6 2024-04-26T02:23:36.207 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:36.204+0000 7f3d8ff3b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T02:23:36.262 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:36.260+0000 7f3d8ff3b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T02:23:36.415 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-04-26T02:23:36.416 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:36.412+0000 7f3d8ff3b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T02:23:36.431 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 6c4063c6-1df9-4fb7-b29e-cdbebf121e3b 7 2024-04-26T02:23:36.480 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:36.476+0000 7f3d8ff3b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T02:23:36.637 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-04-26T02:23:36.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 0b87d6f6-ee22-4c0b-83f7-2e97682943be 8 2024-04-26T02:23:36.724 INFO:tasks.ceph.mgr.y.smithi059.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T02:23:36.724 INFO:tasks.ceph.mgr.y.smithi059.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T02:23:36.724 INFO:tasks.ceph.mgr.y.smithi059.stderr: from numpy import show_config as show_numpy_config 2024-04-26T02:23:36.767 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:36.766+0000 7f4af7bf0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T02:23:36.899 INFO:teuthology.orchestra.run.smithi175.stdout:8 2024-04-26T02:23:36.909 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:36.906+0000 7f4af7bf0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T02:23:36.915 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new fca5962a-8f15-4b46-a0be-570fa8cdb85a 9 2024-04-26T02:23:37.067 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:37.066+0000 7f4af7bf0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T02:23:37.101 INFO:tasks.ceph.mgr.x.smithi175.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-26T02:23:37.101 INFO:tasks.ceph.mgr.x.smithi175.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-26T02:23:37.101 INFO:tasks.ceph.mgr.x.smithi175.stderr: from numpy import show_config as show_numpy_config 2024-04-26T02:23:37.104 INFO:teuthology.orchestra.run.smithi175.stdout:9 2024-04-26T02:23:37.121 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new f2482c62-a013-4dfa-9270-e0d7163d8f3b 10 2024-04-26T02:23:37.134 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:37.134+0000 7f4af7bf0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T02:23:37.149 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:37.144+0000 7f3d8ff3b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T02:23:37.275 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:37.274+0000 7f4af7bf0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T02:23:37.300 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:37.296+0000 7f3d8ff3b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T02:23:37.320 INFO:teuthology.orchestra.run.smithi175.stdout:10 2024-04-26T02:23:37.337 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new c45ddf84-c385-4e2b-bc77-cc9a29dbee0b 11 2024-04-26T02:23:37.458 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:37.452+0000 7f3d8ff3b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T02:23:37.521 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:37.516+0000 7f3d8ff3b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T02:23:37.580 INFO:teuthology.orchestra.run.smithi175.stdout:11 2024-04-26T02:23:37.597 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2 12 2024-04-26T02:23:37.660 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:37.656+0000 7f3d8ff3b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T02:23:37.809 INFO:teuthology.orchestra.run.smithi175.stdout:12 2024-04-26T02:23:37.824 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new b118541d-aac5-4ead-b469-142e5041a0e7 13 2024-04-26T02:23:37.931 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:37.930+0000 7f4af7bf0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T02:23:38.011 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:38.010+0000 7f4af7bf0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T02:23:38.020 INFO:teuthology.orchestra.run.smithi175.stdout:13 2024-04-26T02:23:38.037 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 328780ca-719f-400f-ab8a-d74dd2e68111 14 2024-04-26T02:23:38.201 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:38.198+0000 7f4af7bf0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T02:23:38.242 INFO:teuthology.orchestra.run.smithi175.stdout:14 2024-04-26T02:23:38.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 9bfe9d05-2d08-44e2-9eda-04d63f3cdf96 15 2024-04-26T02:23:38.279 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:38.278+0000 7f4af7bf0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T02:23:38.323 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:38.320+0000 7f3d8ff3b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T02:23:38.402 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:38.396+0000 7f3d8ff3b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T02:23:38.459 INFO:teuthology.orchestra.run.smithi175.stdout:15 2024-04-26T02:23:38.477 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T02:23:38.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T02:23:38.480 INFO:tasks.ceph.osd.0:Started 2024-04-26T02:23:38.480 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T02:23:38.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T02:23:38.482 INFO:tasks.ceph.osd.4:Started 2024-04-26T02:23:38.483 INFO:tasks.ceph.osd.8:Restarting daemon 2024-04-26T02:23:38.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-04-26T02:23:38.485 INFO:tasks.ceph.osd.8:Started 2024-04-26T02:23:38.485 INFO:tasks.ceph.osd.12:Restarting daemon 2024-04-26T02:23:38.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2024-04-26T02:23:38.487 INFO:tasks.ceph.osd.12:Started 2024-04-26T02:23:38.487 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T02:23:38.487 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T02:23:38.489 INFO:tasks.ceph.osd.1:Started 2024-04-26T02:23:38.490 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T02:23:38.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T02:23:38.492 INFO:tasks.ceph.osd.5:Started 2024-04-26T02:23:38.492 INFO:tasks.ceph.osd.9:Restarting daemon 2024-04-26T02:23:38.492 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-04-26T02:23:38.495 INFO:tasks.ceph.osd.9:Started 2024-04-26T02:23:38.495 INFO:tasks.ceph.osd.13:Restarting daemon 2024-04-26T02:23:38.495 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 13 2024-04-26T02:23:38.497 INFO:tasks.ceph.osd.13:Started 2024-04-26T02:23:38.498 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T02:23:38.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T02:23:38.501 INFO:tasks.ceph.osd.2:Started 2024-04-26T02:23:38.501 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T02:23:38.501 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T02:23:38.504 INFO:tasks.ceph.osd.6:Started 2024-04-26T02:23:38.504 INFO:tasks.ceph.osd.10:Restarting daemon 2024-04-26T02:23:38.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-04-26T02:23:38.507 INFO:tasks.ceph.osd.10:Started 2024-04-26T02:23:38.507 INFO:tasks.ceph.osd.14:Restarting daemon 2024-04-26T02:23:38.507 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2024-04-26T02:23:38.509 INFO:tasks.ceph.osd.14:Started 2024-04-26T02:23:38.509 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T02:23:38.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T02:23:38.512 INFO:tasks.ceph.osd.3:Started 2024-04-26T02:23:38.512 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T02:23:38.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T02:23:38.514 INFO:tasks.ceph.osd.7:Started 2024-04-26T02:23:38.514 INFO:tasks.ceph.osd.11:Restarting daemon 2024-04-26T02:23:38.514 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-04-26T02:23:38.517 INFO:tasks.ceph.osd.11:Started 2024-04-26T02:23:38.517 INFO:tasks.ceph.osd.15:Restarting daemon 2024-04-26T02:23:38.517 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 15 2024-04-26T02:23:38.519 INFO:tasks.ceph.osd.15:Started 2024-04-26T02:23:38.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T02:23:38.609 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:38.606+0000 7f4af7bf0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T02:23:38.614 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:38.612+0000 7f3d8ff3b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T02:23:38.678 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:38.674+0000 7f4af7bf0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T02:23:38.687 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:38.684+0000 7f3d8ff3b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T02:23:38.720 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:38.721 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":18,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:23:38.454369+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T02:23:38.454369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:23:38.736 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T02:23:38.736 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T02:23:38.871 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:23:38.868+0000 7f89ad6ab7c0 -1 Falling back to public interface 2024-04-26T02:23:38.976 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:38.972+0000 7f3d8ff3b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T02:23:39.036 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-26T02:23:39.032+0000 7f3d8ff3b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T02:23:39.100 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:23:39.098+0000 7fbb63e607c0 -1 Falling back to public interface 2024-04-26T02:23:39.110 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:23:39.108+0000 7f5ef21587c0 -1 Falling back to public interface 2024-04-26T02:23:39.111 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:23:39.110+0000 7f3d756647c0 -1 Falling back to public interface 2024-04-26T02:23:39.113 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:23:39.108+0000 7f4a069117c0 -1 Falling back to public interface 2024-04-26T02:23:39.113 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:39.108+0000 7f988ad737c0 -1 Falling back to public interface 2024-04-26T02:23:39.114 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:39.108+0000 7fc42e18c7c0 -1 Falling back to public interface 2024-04-26T02:23:39.114 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:23:39.108+0000 7fd7428bc7c0 -1 Falling back to public interface 2024-04-26T02:23:39.115 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:23:39.112+0000 7fe07dccb7c0 -1 Falling back to public interface 2024-04-26T02:23:39.127 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:23:39.126+0000 7f1f5c6937c0 -1 Falling back to public interface 2024-04-26T02:23:39.127 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:23:39.126+0000 7f232a27b7c0 -1 Falling back to public interface 2024-04-26T02:23:39.130 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:23:39.128+0000 7f3006ef77c0 -1 Falling back to public interface 2024-04-26T02:23:39.174 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:23:39.173+0000 7f49a2ffb7c0 -1 Falling back to public interface 2024-04-26T02:23:39.186 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:23:39.185+0000 7f734ebd97c0 -1 Falling back to public interface 2024-04-26T02:23:39.187 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:39.185+0000 7fb92c7a57c0 -1 Falling back to public interface 2024-04-26T02:23:39.197 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:23:39.197+0000 7f2ea1dda7c0 -1 Falling back to public interface 2024-04-26T02:23:39.723 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:39.722+0000 7f4a9f039640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T02:23:39.928 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-26T02:23:39.926+0000 7f4a9f039640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T02:23:40.346 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T02:23:40.641 INFO:teuthology.misc.health.smithi059.stdout: 2024-04-26T02:23:40.642 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":18,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:23:38.454369+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T02:23:38.454369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:23:40.657 DEBUG:teuthology.misc:0 of 16 OSDs are up 2024-04-26T02:23:42.746 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:23:42.744+0000 7f89ad6ab7c0 -1 osd.3 0 log_to_monitors true 2024-04-26T02:23:42.857 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:23:42.852+0000 7f5ef21587c0 -1 osd.7 0 log_to_monitors true 2024-04-26T02:23:42.880 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:23:42.876+0000 7f4a069117c0 -1 osd.9 0 log_to_monitors true 2024-04-26T02:23:42.884 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:42.880+0000 7fc42e18c7c0 -1 osd.1 0 log_to_monitors true 2024-04-26T02:23:42.890 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:23:42.885+0000 7fbb63e607c0 -1 osd.0 0 log_to_monitors true 2024-04-26T02:23:42.931 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:23:42.929+0000 7f3d756647c0 -1 osd.12 0 log_to_monitors true 2024-04-26T02:23:42.940 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:23:42.937+0000 7f49a2ffb7c0 -1 osd.2 0 log_to_monitors true 2024-04-26T02:23:42.950 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:42.949+0000 7fb92c7a57c0 -1 osd.14 0 log_to_monitors true 2024-04-26T02:23:42.971 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:42.964+0000 7f988ad737c0 -1 osd.13 0 log_to_monitors true 2024-04-26T02:23:42.984 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:23:42.980+0000 7fe07dccb7c0 -1 osd.15 0 log_to_monitors true 2024-04-26T02:23:42.988 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:23:42.984+0000 7fd7428bc7c0 -1 osd.5 0 log_to_monitors true 2024-04-26T02:23:43.053 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:23:43.049+0000 7f1f5c6937c0 -1 osd.4 0 log_to_monitors true 2024-04-26T02:23:43.053 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:23:43.049+0000 7f232a27b7c0 -1 osd.8 0 log_to_monitors true 2024-04-26T02:23:43.076 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:23:43.072+0000 7f3006ef77c0 -1 osd.11 0 log_to_monitors true 2024-04-26T02:23:43.086 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:23:43.085+0000 7f734ebd97c0 -1 osd.10 0 log_to_monitors true 2024-04-26T02:23:43.120 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:23:43.117+0000 7f2ea1dda7c0 -1 osd.6 0 log_to_monitors true 2024-04-26T02:23:43.799 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:23:43.800+0000 7f89a8e31640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T02:23:43.810 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:23:43.808+0000 7f89a5480640 -1 osd.3 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.791 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:23:44.788+0000 7f4a02097640 -1 osd.9 0 waiting for initial osdmap 2024-04-26T02:23:44.792 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:23:44.789+0000 7f499e781640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T02:23:44.792 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:23:44.792+0000 7fe079451640 -1 osd.15 0 waiting for initial osdmap 2024-04-26T02:23:44.793 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:44.788+0000 7f98864f9640 -1 osd.13 0 waiting for initial osdmap 2024-04-26T02:23:44.794 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:44.793+0000 7fb927f2b640 -1 osd.14 0 waiting for initial osdmap 2024-04-26T02:23:44.794 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:23:44.796+0000 7f300267d640 -1 osd.11 0 waiting for initial osdmap 2024-04-26T02:23:44.795 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:44.792+0000 7fc429912640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T02:23:44.796 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:23:44.793+0000 7f2e9d560640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T02:23:44.806 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:23:44.800+0000 7f49fe6e6640 -1 osd.9 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.814 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:23:44.813+0000 7f499add0640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.815 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:23:44.816+0000 7fe075aa0640 -1 osd.15 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.824 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:44.820+0000 7fc425f61640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.824 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:44.820+0000 7f9882b48640 -1 osd.13 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.831 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:23:44.829+0000 7f2e99baf640 -1 osd.6 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.833 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:23:44.832+0000 7f2ffeccc640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:44.833 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:44.833+0000 7fb92457a640 -1 osd.14 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:45.526 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:23:45.520+0000 7fd73e042640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T02:23:45.560 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:23:45.556+0000 7fd736689640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:45.564 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:23:45.560+0000 7fd7312ca640 -1 osd.5 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:45.664 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:23:45.661+0000 7f734a35f640 -1 osd.10 0 waiting for initial osdmap 2024-04-26T02:23:45.665 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:23:45.664+0000 7f5eed8de640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T02:23:45.694 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:23:45.693+0000 7f73429a6640 -1 osd.10 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:45.752 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:23:45.752+0000 7f5ee5f25640 -1 osd.7 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:45.757 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:23:45.756+0000 7f5ee0b66640 -1 osd.7 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:47.083 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:23:47.077+0000 7fbb5f5e6640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T02:23:47.097 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:23:47.093+0000 7f3d70dea640 -1 osd.12 0 waiting for initial osdmap 2024-04-26T02:23:47.108 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:23:47.105+0000 7f2325a01640 -1 osd.8 0 waiting for initial osdmap 2024-04-26T02:23:47.111 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:23:47.109+0000 7fbb57c2d640 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:47.131 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:23:47.129+0000 7f3d69431640 -1 osd.12 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:47.139 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:23:47.137+0000 7f231e048640 -1 osd.8 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:47.170 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:23:47.169+0000 7f1f5964f640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T02:23:47.193 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:23:47.189+0000 7f1f50460640 -1 osd.4 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:23:48.266 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T02:23:48.576 INFO:teuthology.misc.health.smithi059.stdout: 2024-04-26T02:23:48.576 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":24,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:23:47.877494+0000","last_up_change":"2024-04-26T02:23:47.877494+0000","last_in_change":"2024-04-26T02:23:38.454369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T02:23:46.791952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6803","nonce":2847130092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6805","nonce":2847130092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6809","nonce":2847130092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6807","nonce":2847130092}]},"public_addr":"172.21.15.59:6803/2847130092","cluster_addr":"172.21.15.59:6805/2847130092","heartbeat_back_addr":"172.21.15.59:6809/2847130092","heartbeat_front_addr":"172.21.15.59:6807/2847130092","state":["exists","up"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6813","nonce":504096392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6821","nonce":504096392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6829","nonce":504096392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6826","nonce":504096392}]},"public_addr":"172.21.15.136:6813/504096392","cluster_addr":"172.21.15.136:6821/504096392","heartbeat_back_addr":"172.21.15.136:6829/504096392","heartbeat_front_addr":"172.21.15.136:6826/504096392","state":["exists","up"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6801","nonce":785558131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6803","nonce":785558131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6807","nonce":785558131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6805","nonce":785558131}]},"public_addr":"172.21.15.142:6801/785558131","cluster_addr":"172.21.15.142:6803/785558131","heartbeat_back_addr":"172.21.15.142:6807/785558131","heartbeat_front_addr":"172.21.15.142:6805/785558131","state":["exists","up"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6801","nonce":3691596427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6803","nonce":3691596427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6807","nonce":3691596427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6805","nonce":3691596427}]},"public_addr":"172.21.15.175:6801/3691596427","cluster_addr":"172.21.15.175:6803/3691596427","heartbeat_back_addr":"172.21.15.175:6807/3691596427","heartbeat_front_addr":"172.21.15.175:6805/3691596427","state":["exists","up"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6821","nonce":2291404497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6823","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6825","nonce":2291404497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6831","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6833","nonce":2291404497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6827","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6829","nonce":2291404497}]},"public_addr":"172.21.15.59:6821/2291404497","cluster_addr":"172.21.15.59:6825/2291404497","heartbeat_back_addr":"172.21.15.59:6833/2291404497","heartbeat_front_addr":"172.21.15.59:6829/2291404497","state":["exists","up"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6815","nonce":3420144978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6823","nonce":3420144978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6831","nonce":3420144978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6827","nonce":3420144978}]},"public_addr":"172.21.15.136:6815/3420144978","cluster_addr":"172.21.15.136:6823/3420144978","heartbeat_back_addr":"172.21.15.136:6831/3420144978","heartbeat_front_addr":"172.21.15.136:6827/3420144978","state":["exists","up"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6825","nonce":2443484296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6827","nonce":2443484296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6831","nonce":2443484296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6829","nonce":2443484296}]},"public_addr":"172.21.15.142:6825/2443484296","cluster_addr":"172.21.15.142:6827/2443484296","heartbeat_back_addr":"172.21.15.142:6831/2443484296","heartbeat_front_addr":"172.21.15.142:6829/2443484296","state":["exists","up"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6809","nonce":1727563740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6811","nonce":1727563740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6815","nonce":1727563740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6813","nonce":1727563740}]},"public_addr":"172.21.15.175:6809/1727563740","cluster_addr":"172.21.15.175:6811/1727563740","heartbeat_back_addr":"172.21.15.175:6815/1727563740","heartbeat_front_addr":"172.21.15.175:6813/1727563740","state":["exists","up"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6820","nonce":652278083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6824","nonce":652278083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6832","nonce":652278083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6828","nonce":652278083}]},"public_addr":"172.21.15.59:6820/652278083","cluster_addr":"172.21.15.59:6824/652278083","heartbeat_back_addr":"172.21.15.59:6832/652278083","heartbeat_front_addr":"172.21.15.59:6828/652278083","state":["exists","up"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6802","nonce":1522341187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6806","nonce":1522341187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6820","nonce":1522341187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6812","nonce":1522341187}]},"public_addr":"172.21.15.136:6802/1522341187","cluster_addr":"172.21.15.136:6806/1522341187","heartbeat_back_addr":"172.21.15.136:6820/1522341187","heartbeat_front_addr":"172.21.15.136:6812/1522341187","state":["exists","up"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6810","nonce":2358058219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6813","nonce":2358058219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6819","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6820","nonce":2358058219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6815","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6817","nonce":2358058219}]},"public_addr":"172.21.15.142:6810/2358058219","cluster_addr":"172.21.15.142:6813/2358058219","heartbeat_back_addr":"172.21.15.142:6820/2358058219","heartbeat_front_addr":"172.21.15.142:6817/2358058219","state":["exists","up"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6825","nonce":3853198939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6827","nonce":3853198939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6831","nonce":3853198939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6829","nonce":3853198939}]},"public_addr":"172.21.15.175:6825/3853198939","cluster_addr":"172.21.15.175:6827/3853198939","heartbeat_back_addr":"172.21.15.175:6831/3853198939","heartbeat_front_addr":"172.21.15.175:6829/3853198939","state":["exists","up"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6811","nonce":753845278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6813","nonce":753845278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6817","nonce":753845278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6815","nonce":753845278}]},"public_addr":"172.21.15.59:6811/753845278","cluster_addr":"172.21.15.59:6813/753845278","heartbeat_back_addr":"172.21.15.59:6817/753845278","heartbeat_front_addr":"172.21.15.59:6815/753845278","state":["exists","up"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6803","nonce":2997471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6807","nonce":2997471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6822","nonce":2997471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6814","nonce":2997471095}]},"public_addr":"172.21.15.136:6803/2997471095","cluster_addr":"172.21.15.136:6807/2997471095","heartbeat_back_addr":"172.21.15.136:6822/2997471095","heartbeat_front_addr":"172.21.15.136:6814/2997471095","state":["exists","up"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6811","nonce":4003882581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6816","nonce":4003882581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6823","nonce":4003882581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6821","nonce":4003882581}]},"public_addr":"172.21.15.142:6811/4003882581","cluster_addr":"172.21.15.142:6816/4003882581","heartbeat_back_addr":"172.21.15.142:6823/4003882581","heartbeat_front_addr":"172.21.15.142:6821/4003882581","state":["exists","up"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6817","nonce":1433451080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6819","nonce":1433451080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6823","nonce":1433451080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6821","nonce":1433451080}]},"public_addr":"172.21.15.175:6817/1433451080","cluster_addr":"172.21.15.175:6819/1433451080","heartbeat_back_addr":"172.21.15.175:6823/1433451080","heartbeat_front_addr":"172.21.15.175:6821/1433451080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.922594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.919354+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.722321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.003178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.153422+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.817321+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.928283+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.127980+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.069873+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.963529+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.969599+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.972501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:23:48.594 DEBUG:teuthology.misc:16 of 16 OSDs are up 2024-04-26T02:23:48.594 INFO:tasks.ceph:Creating RBD pool 2024-04-26T02:23:48.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T02:23:49.906 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'rbd' created 2024-04-26T02:23:49.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T02:23:50.909 INFO:teuthology.orchestra.run.smithi059.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T02:23:50.938 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T02:23:50.938 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T02:23:50.939 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T02:23:50.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T02:23:50.939 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T02:23:51.289 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:51.308 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":3969194441},{"type":"v1","addr":"172.21.15.59:6801","nonce":3969194441}]},"active_addr":"172.21.15.59:6801/3969194441","active_change":"2024-04-26T02:23:38.701082+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":2043903922}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":846558918}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":3914199132}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.59:0","nonce":884677261}]}]} 2024-04-26T02:23:51.313 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T02:23:51.313 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T02:23:51.313 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T02:23:51.633 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:51.633 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":27,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:23:50.907221+0000","last_up_change":"2024-04-26T02:23:47.877494+0000","last_in_change":"2024-04-26T02:23:38.454369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T02:23:46.791952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T02:23:48.950495+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6803","nonce":2847130092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6805","nonce":2847130092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6809","nonce":2847130092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6807","nonce":2847130092}]},"public_addr":"172.21.15.59:6803/2847130092","cluster_addr":"172.21.15.59:6805/2847130092","heartbeat_back_addr":"172.21.15.59:6809/2847130092","heartbeat_front_addr":"172.21.15.59:6807/2847130092","state":["exists","up"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6813","nonce":504096392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6821","nonce":504096392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6829","nonce":504096392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6826","nonce":504096392}]},"public_addr":"172.21.15.136:6813/504096392","cluster_addr":"172.21.15.136:6821/504096392","heartbeat_back_addr":"172.21.15.136:6829/504096392","heartbeat_front_addr":"172.21.15.136:6826/504096392","state":["exists","up"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6801","nonce":785558131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6803","nonce":785558131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6807","nonce":785558131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6805","nonce":785558131}]},"public_addr":"172.21.15.142:6801/785558131","cluster_addr":"172.21.15.142:6803/785558131","heartbeat_back_addr":"172.21.15.142:6807/785558131","heartbeat_front_addr":"172.21.15.142:6805/785558131","state":["exists","up"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6801","nonce":3691596427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6803","nonce":3691596427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6807","nonce":3691596427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6805","nonce":3691596427}]},"public_addr":"172.21.15.175:6801/3691596427","cluster_addr":"172.21.15.175:6803/3691596427","heartbeat_back_addr":"172.21.15.175:6807/3691596427","heartbeat_front_addr":"172.21.15.175:6805/3691596427","state":["exists","up"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6821","nonce":2291404497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6823","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6825","nonce":2291404497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6831","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6833","nonce":2291404497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6827","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6829","nonce":2291404497}]},"public_addr":"172.21.15.59:6821/2291404497","cluster_addr":"172.21.15.59:6825/2291404497","heartbeat_back_addr":"172.21.15.59:6833/2291404497","heartbeat_front_addr":"172.21.15.59:6829/2291404497","state":["exists","up"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6815","nonce":3420144978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6823","nonce":3420144978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6831","nonce":3420144978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6827","nonce":3420144978}]},"public_addr":"172.21.15.136:6815/3420144978","cluster_addr":"172.21.15.136:6823/3420144978","heartbeat_back_addr":"172.21.15.136:6831/3420144978","heartbeat_front_addr":"172.21.15.136:6827/3420144978","state":["exists","up"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6825","nonce":2443484296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6827","nonce":2443484296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6831","nonce":2443484296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6829","nonce":2443484296}]},"public_addr":"172.21.15.142:6825/2443484296","cluster_addr":"172.21.15.142:6827/2443484296","heartbeat_back_addr":"172.21.15.142:6831/2443484296","heartbeat_front_addr":"172.21.15.142:6829/2443484296","state":["exists","up"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6809","nonce":1727563740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6811","nonce":1727563740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6815","nonce":1727563740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6813","nonce":1727563740}]},"public_addr":"172.21.15.175:6809/1727563740","cluster_addr":"172.21.15.175:6811/1727563740","heartbeat_back_addr":"172.21.15.175:6815/1727563740","heartbeat_front_addr":"172.21.15.175:6813/1727563740","state":["exists","up"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6820","nonce":652278083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6824","nonce":652278083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6832","nonce":652278083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6828","nonce":652278083}]},"public_addr":"172.21.15.59:6820/652278083","cluster_addr":"172.21.15.59:6824/652278083","heartbeat_back_addr":"172.21.15.59:6832/652278083","heartbeat_front_addr":"172.21.15.59:6828/652278083","state":["exists","up"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6802","nonce":1522341187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6806","nonce":1522341187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6820","nonce":1522341187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6812","nonce":1522341187}]},"public_addr":"172.21.15.136:6802/1522341187","cluster_addr":"172.21.15.136:6806/1522341187","heartbeat_back_addr":"172.21.15.136:6820/1522341187","heartbeat_front_addr":"172.21.15.136:6812/1522341187","state":["exists","up"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6810","nonce":2358058219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6813","nonce":2358058219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6819","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6820","nonce":2358058219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6815","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6817","nonce":2358058219}]},"public_addr":"172.21.15.142:6810/2358058219","cluster_addr":"172.21.15.142:6813/2358058219","heartbeat_back_addr":"172.21.15.142:6820/2358058219","heartbeat_front_addr":"172.21.15.142:6817/2358058219","state":["exists","up"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6825","nonce":3853198939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6827","nonce":3853198939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6831","nonce":3853198939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6829","nonce":3853198939}]},"public_addr":"172.21.15.175:6825/3853198939","cluster_addr":"172.21.15.175:6827/3853198939","heartbeat_back_addr":"172.21.15.175:6831/3853198939","heartbeat_front_addr":"172.21.15.175:6829/3853198939","state":["exists","up"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6811","nonce":753845278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6813","nonce":753845278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6817","nonce":753845278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6815","nonce":753845278}]},"public_addr":"172.21.15.59:6811/753845278","cluster_addr":"172.21.15.59:6813/753845278","heartbeat_back_addr":"172.21.15.59:6817/753845278","heartbeat_front_addr":"172.21.15.59:6815/753845278","state":["exists","up"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6803","nonce":2997471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6807","nonce":2997471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6822","nonce":2997471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6814","nonce":2997471095}]},"public_addr":"172.21.15.136:6803/2997471095","cluster_addr":"172.21.15.136:6807/2997471095","heartbeat_back_addr":"172.21.15.136:6822/2997471095","heartbeat_front_addr":"172.21.15.136:6814/2997471095","state":["exists","up"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6811","nonce":4003882581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6816","nonce":4003882581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6823","nonce":4003882581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6821","nonce":4003882581}]},"public_addr":"172.21.15.142:6811/4003882581","cluster_addr":"172.21.15.142:6816/4003882581","heartbeat_back_addr":"172.21.15.142:6823/4003882581","heartbeat_front_addr":"172.21.15.142:6821/4003882581","state":["exists","up"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6817","nonce":1433451080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6819","nonce":1433451080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6823","nonce":1433451080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6821","nonce":1433451080}]},"public_addr":"172.21.15.175:6817/1433451080","cluster_addr":"172.21.15.175:6819/1433451080","heartbeat_back_addr":"172.21.15.175:6823/1433451080","heartbeat_front_addr":"172.21.15.175:6821/1433451080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.859141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.922594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.919354+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.722321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.073523+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.003178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.153422+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.817321+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.039000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.928283+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.127980+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.069873+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.888934+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.963529+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.969599+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.972501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:23:51.652 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T02:23:51.653 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T02:23:51.959 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:51.959 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:23:51.919802+0000","last_up_change":"2024-04-26T02:23:47.877494+0000","last_in_change":"2024-04-26T02:23:38.454369+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T02:23:46.791952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T02:23:48.950495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6803","nonce":2847130092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6805","nonce":2847130092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6809","nonce":2847130092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6807","nonce":2847130092}]},"public_addr":"172.21.15.59:6803/2847130092","cluster_addr":"172.21.15.59:6805/2847130092","heartbeat_back_addr":"172.21.15.59:6809/2847130092","heartbeat_front_addr":"172.21.15.59:6807/2847130092","state":["exists","up"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6813","nonce":504096392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6821","nonce":504096392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6829","nonce":504096392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6826","nonce":504096392}]},"public_addr":"172.21.15.136:6813/504096392","cluster_addr":"172.21.15.136:6821/504096392","heartbeat_back_addr":"172.21.15.136:6829/504096392","heartbeat_front_addr":"172.21.15.136:6826/504096392","state":["exists","up"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6801","nonce":785558131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6803","nonce":785558131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6807","nonce":785558131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6805","nonce":785558131}]},"public_addr":"172.21.15.142:6801/785558131","cluster_addr":"172.21.15.142:6803/785558131","heartbeat_back_addr":"172.21.15.142:6807/785558131","heartbeat_front_addr":"172.21.15.142:6805/785558131","state":["exists","up"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6801","nonce":3691596427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6803","nonce":3691596427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6807","nonce":3691596427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6805","nonce":3691596427}]},"public_addr":"172.21.15.175:6801/3691596427","cluster_addr":"172.21.15.175:6803/3691596427","heartbeat_back_addr":"172.21.15.175:6807/3691596427","heartbeat_front_addr":"172.21.15.175:6805/3691596427","state":["exists","up"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6821","nonce":2291404497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6823","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6825","nonce":2291404497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6831","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6833","nonce":2291404497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6827","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6829","nonce":2291404497}]},"public_addr":"172.21.15.59:6821/2291404497","cluster_addr":"172.21.15.59:6825/2291404497","heartbeat_back_addr":"172.21.15.59:6833/2291404497","heartbeat_front_addr":"172.21.15.59:6829/2291404497","state":["exists","up"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6815","nonce":3420144978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6823","nonce":3420144978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6831","nonce":3420144978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6827","nonce":3420144978}]},"public_addr":"172.21.15.136:6815/3420144978","cluster_addr":"172.21.15.136:6823/3420144978","heartbeat_back_addr":"172.21.15.136:6831/3420144978","heartbeat_front_addr":"172.21.15.136:6827/3420144978","state":["exists","up"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6825","nonce":2443484296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6827","nonce":2443484296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6831","nonce":2443484296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6829","nonce":2443484296}]},"public_addr":"172.21.15.142:6825/2443484296","cluster_addr":"172.21.15.142:6827/2443484296","heartbeat_back_addr":"172.21.15.142:6831/2443484296","heartbeat_front_addr":"172.21.15.142:6829/2443484296","state":["exists","up"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6809","nonce":1727563740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6811","nonce":1727563740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6815","nonce":1727563740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6813","nonce":1727563740}]},"public_addr":"172.21.15.175:6809/1727563740","cluster_addr":"172.21.15.175:6811/1727563740","heartbeat_back_addr":"172.21.15.175:6815/1727563740","heartbeat_front_addr":"172.21.15.175:6813/1727563740","state":["exists","up"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6820","nonce":652278083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6824","nonce":652278083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6832","nonce":652278083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6828","nonce":652278083}]},"public_addr":"172.21.15.59:6820/652278083","cluster_addr":"172.21.15.59:6824/652278083","heartbeat_back_addr":"172.21.15.59:6832/652278083","heartbeat_front_addr":"172.21.15.59:6828/652278083","state":["exists","up"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6802","nonce":1522341187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6806","nonce":1522341187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6820","nonce":1522341187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6812","nonce":1522341187}]},"public_addr":"172.21.15.136:6802/1522341187","cluster_addr":"172.21.15.136:6806/1522341187","heartbeat_back_addr":"172.21.15.136:6820/1522341187","heartbeat_front_addr":"172.21.15.136:6812/1522341187","state":["exists","up"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6810","nonce":2358058219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6813","nonce":2358058219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6819","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6820","nonce":2358058219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6815","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6817","nonce":2358058219}]},"public_addr":"172.21.15.142:6810/2358058219","cluster_addr":"172.21.15.142:6813/2358058219","heartbeat_back_addr":"172.21.15.142:6820/2358058219","heartbeat_front_addr":"172.21.15.142:6817/2358058219","state":["exists","up"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6825","nonce":3853198939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6827","nonce":3853198939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6831","nonce":3853198939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6829","nonce":3853198939}]},"public_addr":"172.21.15.175:6825/3853198939","cluster_addr":"172.21.15.175:6827/3853198939","heartbeat_back_addr":"172.21.15.175:6831/3853198939","heartbeat_front_addr":"172.21.15.175:6829/3853198939","state":["exists","up"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6811","nonce":753845278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6813","nonce":753845278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6817","nonce":753845278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6815","nonce":753845278}]},"public_addr":"172.21.15.59:6811/753845278","cluster_addr":"172.21.15.59:6813/753845278","heartbeat_back_addr":"172.21.15.59:6817/753845278","heartbeat_front_addr":"172.21.15.59:6815/753845278","state":["exists","up"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6803","nonce":2997471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6807","nonce":2997471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6822","nonce":2997471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6814","nonce":2997471095}]},"public_addr":"172.21.15.136:6803/2997471095","cluster_addr":"172.21.15.136:6807/2997471095","heartbeat_back_addr":"172.21.15.136:6822/2997471095","heartbeat_front_addr":"172.21.15.136:6814/2997471095","state":["exists","up"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6811","nonce":4003882581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6816","nonce":4003882581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6823","nonce":4003882581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6821","nonce":4003882581}]},"public_addr":"172.21.15.142:6811/4003882581","cluster_addr":"172.21.15.142:6816/4003882581","heartbeat_back_addr":"172.21.15.142:6823/4003882581","heartbeat_front_addr":"172.21.15.142:6821/4003882581","state":["exists","up"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6817","nonce":1433451080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6819","nonce":1433451080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6823","nonce":1433451080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6821","nonce":1433451080}]},"public_addr":"172.21.15.175:6817/1433451080","cluster_addr":"172.21.15.175:6819/1433451080","heartbeat_back_addr":"172.21.15.175:6823/1433451080","heartbeat_front_addr":"172.21.15.175:6821/1433451080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.859141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.922594+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.919354+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.722321+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.073523+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.003178+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.153422+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.817321+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.039000+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.928283+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.127980+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:44.069873+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.888934+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.963529+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.969599+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.972501+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:23:51.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T02:23:51.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T02:23:51.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T02:23:51.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T02:23:51.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T02:23:51.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T02:23:51.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T02:23:51.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T02:23:51.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-04-26T02:23:51.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-04-26T02:23:51.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-04-26T02:23:51.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-04-26T02:23:51.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-04-26T02:23:51.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-04-26T02:23:51.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-04-26T02:23:51.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-04-26T02:23:52.423 INFO:teuthology.orchestra.run.smithi059.stdout:90194313219 2024-04-26T02:23:52.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T02:23:52.433 INFO:teuthology.orchestra.run.smithi059.stdout:103079215107 2024-04-26T02:23:52.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T02:23:52.448 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:52.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T02:23:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:103079215107 2024-04-26T02:23:52.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T02:23:52.472 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:52.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-04-26T02:23:52.487 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:52.487 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:52.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-04-26T02:23:52.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-04-26T02:23:52.510 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:52.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-04-26T02:23:52.524 INFO:teuthology.orchestra.run.smithi059.stdout:103079215107 2024-04-26T02:23:52.525 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-04-26T02:23:52.526 INFO:teuthology.orchestra.run.smithi059.stdout:94489280517 2024-04-26T02:23:52.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T02:23:52.548 INFO:teuthology.orchestra.run.smithi059.stdout:103079215110 2024-04-26T02:23:52.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-04-26T02:23:52.552 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:52.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T02:23:52.571 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:52.572 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-04-26T02:23:52.577 INFO:teuthology.orchestra.run.smithi059.stdout:94489280517 2024-04-26T02:23:52.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T02:23:52.627 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:52.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-04-26T02:23:52.639 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:52.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T02:23:53.243 INFO:teuthology.orchestra.run.smithi059.stdout:103079215107 2024-04-26T02:23:53.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.4 2024-04-26T02:23:53.304 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.343 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:53.394 INFO:teuthology.orchestra.run.smithi059.stdout:103079215107 2024-04-26T02:23:53.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.9 2024-04-26T02:23:53.423 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.0 2024-04-26T02:23:53.448 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.466 INFO:teuthology.orchestra.run.smithi059.stdout:94489280517 2024-04-26T02:23:53.490 INFO:teuthology.orchestra.run.smithi059.stdout:94489280517 2024-04-26T02:23:53.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.2 2024-04-26T02:23:53.510 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.514 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:53.538 INFO:teuthology.orchestra.run.smithi059.stdout:90194313219 2024-04-26T02:23:53.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.1 2024-04-26T02:23:53.542 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.15 2024-04-26T02:23:53.557 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.564 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:53.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313219 got 90194313219 for osd.3 2024-04-26T02:23:53.576 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:53.576 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.592 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:53.593 INFO:teuthology.orchestra.run.smithi059.stdout:103079215110 2024-04-26T02:23:53.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.5 2024-04-26T02:23:53.595 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.614 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:53.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.13 2024-04-26T02:23:53.626 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.10 2024-04-26T02:23:53.627 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215110 got 103079215110 for osd.12 2024-04-26T02:23:53.628 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.630 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:53.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.14 2024-04-26T02:23:53.644 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.6 2024-04-26T02:23:53.649 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.653 INFO:teuthology.orchestra.run.smithi059.stdout:94489280516 2024-04-26T02:23:53.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.11 2024-04-26T02:23:53.670 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.680 INFO:teuthology.orchestra.run.smithi059.stdout:103079215107 2024-04-26T02:23:53.695 INFO:teuthology.orchestra.run.smithi059.stdout:94489280515 2024-04-26T02:23:53.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.8 2024-04-26T02:23:53.699 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.7 2024-04-26T02:23:53.713 DEBUG:teuthology.parallel:result is None 2024-04-26T02:23:53.713 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T02:23:53.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:23:54.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:54.036 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:23:54.054 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T02:23:52.710005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":438356,"kb_used_data":5344,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511084,"statfs":{"total":1546188226560,"available":1545739350016,"internally_reserved":0,"allocated":5472256,"data_stored":2780478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":442473555},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.786868"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928472+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:23:51.928472+0000","last_peered":"2024-04-26T02:23:51.928472+0000","last_clean":"2024-04-26T02:23:51.928472+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:23:51.928472+0000","last_undegraded":"2024-04-26T02:23:51.928472+0000","last_fullsized":"2024-04-26T02:23:51.928472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927558+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:23:50.927558+0000","last_peered":"2024-04-26T02:23:50.927558+0000","last_clean":"2024-04-26T02:23:50.927558+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:23:50.927558+0000","last_undegraded":"2024-04-26T02:23:50.927558+0000","last_fullsized":"2024-04-26T02:23:50.927558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.897763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:52.187055+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:23:52.187055+0000","last_peered":"2024-04-26T02:23:52.187055+0000","last_clean":"2024-04-26T02:23:52.187055+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:23:52.187055+0000","last_undegraded":"2024-04-26T02:23:52.187055+0000","last_fullsized":"2024-04-26T02:23:52.187055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.927825+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:23:51.927825+0000","last_peered":"2024-04-26T02:23:51.927825+0000","last_clean":"2024-04-26T02:23:51.927825+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:23:51.927825+0000","last_undegraded":"2024-04-26T02:23:51.927825+0000","last_fullsized":"2024-04-26T02:23:51.927825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928203+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:23:51.928203+0000","last_peered":"2024-04-26T02:23:51.928203+0000","last_clean":"2024-04-26T02:23:51.928203+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:23:51.928203+0000","last_undegraded":"2024-04-26T02:23:51.928203+0000","last_fullsized":"2024-04-26T02:23:51.928203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927824+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:23:50.927824+0000","last_peered":"2024-04-26T02:23:50.927824+0000","last_clean":"2024-04-26T02:23:50.927824+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:23:50.927824+0000","last_undegraded":"2024-04-26T02:23:50.927824+0000","last_fullsized":"2024-04-26T02:23:50.927824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:04.893032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928324+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:23:51.928324+0000","last_peered":"2024-04-26T02:23:51.928324+0000","last_clean":"2024-04-26T02:23:51.928324+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:23:51.928324+0000","last_undegraded":"2024-04-26T02:23:51.928324+0000","last_fullsized":"2024-04-26T02:23:51.928324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.663311+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:23:51.663311+0000","last_peered":"2024-04-26T02:23:51.663311+0000","last_clean":"2024-04-26T02:23:51.663311+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:23:51.663311+0000","last_undegraded":"2024-04-26T02:23:51.663311+0000","last_fullsized":"2024-04-26T02:23:51.663311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:58.263438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'157","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.658303+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:23:51.658303+0000","last_peered":"2024-04-26T02:23:51.658303+0000","last_clean":"2024-04-26T02:23:51.658303+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:23:51.658303+0000","last_undegraded":"2024-04-26T02:23:51.658303+0000","last_fullsized":"2024-04-26T02:23:51.658303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215107,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215107,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":97573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,3,5,7,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[3,4,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280515,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280515,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[3,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[3,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215107,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:23:54.056 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:23:54.392 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:54.392 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:23:54.410 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-26T02:23:52.710005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":438356,"kb_used_data":5344,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511084,"statfs":{"total":1546188226560,"available":1545739350016,"internally_reserved":0,"allocated":5472256,"data_stored":2780478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":442473555},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.786868"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928472+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:23:51.928472+0000","last_peered":"2024-04-26T02:23:51.928472+0000","last_clean":"2024-04-26T02:23:51.928472+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:23:51.928472+0000","last_undegraded":"2024-04-26T02:23:51.928472+0000","last_fullsized":"2024-04-26T02:23:51.928472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927558+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:23:50.927558+0000","last_peered":"2024-04-26T02:23:50.927558+0000","last_clean":"2024-04-26T02:23:50.927558+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:23:50.927558+0000","last_undegraded":"2024-04-26T02:23:50.927558+0000","last_fullsized":"2024-04-26T02:23:50.927558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.897763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:52.187055+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:23:52.187055+0000","last_peered":"2024-04-26T02:23:52.187055+0000","last_clean":"2024-04-26T02:23:52.187055+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:23:52.187055+0000","last_undegraded":"2024-04-26T02:23:52.187055+0000","last_fullsized":"2024-04-26T02:23:52.187055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.927825+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:23:51.927825+0000","last_peered":"2024-04-26T02:23:51.927825+0000","last_clean":"2024-04-26T02:23:51.927825+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:23:51.927825+0000","last_undegraded":"2024-04-26T02:23:51.927825+0000","last_fullsized":"2024-04-26T02:23:51.927825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928203+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:23:51.928203+0000","last_peered":"2024-04-26T02:23:51.928203+0000","last_clean":"2024-04-26T02:23:51.928203+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:23:51.928203+0000","last_undegraded":"2024-04-26T02:23:51.928203+0000","last_fullsized":"2024-04-26T02:23:51.928203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927824+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:23:50.927824+0000","last_peered":"2024-04-26T02:23:50.927824+0000","last_clean":"2024-04-26T02:23:50.927824+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:23:50.927824+0000","last_undegraded":"2024-04-26T02:23:50.927824+0000","last_fullsized":"2024-04-26T02:23:50.927824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:04.893032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928324+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:23:51.928324+0000","last_peered":"2024-04-26T02:23:51.928324+0000","last_clean":"2024-04-26T02:23:51.928324+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:23:51.928324+0000","last_undegraded":"2024-04-26T02:23:51.928324+0000","last_fullsized":"2024-04-26T02:23:51.928324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.663311+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:23:51.663311+0000","last_peered":"2024-04-26T02:23:51.663311+0000","last_clean":"2024-04-26T02:23:51.663311+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:23:51.663311+0000","last_undegraded":"2024-04-26T02:23:51.663311+0000","last_fullsized":"2024-04-26T02:23:51.663311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:58.263438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'157","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.658303+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:23:51.658303+0000","last_peered":"2024-04-26T02:23:51.658303+0000","last_clean":"2024-04-26T02:23:51.658303+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:23:51.658303+0000","last_undegraded":"2024-04-26T02:23:51.658303+0000","last_fullsized":"2024-04-26T02:23:51.658303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215110,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215107,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215107,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":97573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,3,5,7,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[3,4,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280515,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280515,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[3,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[3,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215107,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:23:54.411 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T02:23:54.412 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T02:23:54.412 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T02:23:54.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T02:23:54.726 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:54.726 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T02:23:54.744 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T02:23:54.744 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T02:23:54.757 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T02:23:54.757 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-yuri2-testing-2024-04-24-0914-squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 2500, 'ms tcp read timeout': 5}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.1, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'slow request', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2024-04-24-0914-squid', 'sha1': 'ddeaa91797339a19172c3036ff48cca58c12f448'}} 2024-04-26T02:23:54.758 INFO:tasks.thrashosds:config is {'bluestore_new_sharding': 'random', 'chance_bluestore_reshard': 1, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'min_in': 8, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T02:23:54.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T02:23:55.078 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T02:23:55.078 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T02:23:55.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:23:55.359 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:55.359 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:23:55.376 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T02:23:54.710539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":438404,"kb_used_data":5392,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511036,"statfs":{"total":1546188226560,"available":1545739300864,"internally_reserved":0,"allocated":5521408,"data_stored":2808904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":442473555},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.787403"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928472+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:23:51.928472+0000","last_peered":"2024-04-26T02:23:51.928472+0000","last_clean":"2024-04-26T02:23:51.928472+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:23:51.928472+0000","last_undegraded":"2024-04-26T02:23:51.928472+0000","last_fullsized":"2024-04-26T02:23:51.928472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927558+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:23:50.927558+0000","last_peered":"2024-04-26T02:23:50.927558+0000","last_clean":"2024-04-26T02:23:50.927558+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:23:50.927558+0000","last_undegraded":"2024-04-26T02:23:50.927558+0000","last_fullsized":"2024-04-26T02:23:50.927558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.897763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:52.187055+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:23:52.187055+0000","last_peered":"2024-04-26T02:23:52.187055+0000","last_clean":"2024-04-26T02:23:52.187055+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:23:52.187055+0000","last_undegraded":"2024-04-26T02:23:52.187055+0000","last_fullsized":"2024-04-26T02:23:52.187055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.927825+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:23:51.927825+0000","last_peered":"2024-04-26T02:23:51.927825+0000","last_clean":"2024-04-26T02:23:51.927825+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:23:51.927825+0000","last_undegraded":"2024-04-26T02:23:51.927825+0000","last_fullsized":"2024-04-26T02:23:51.927825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928203+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:23:51.928203+0000","last_peered":"2024-04-26T02:23:51.928203+0000","last_clean":"2024-04-26T02:23:51.928203+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:23:51.928203+0000","last_undegraded":"2024-04-26T02:23:51.928203+0000","last_fullsized":"2024-04-26T02:23:51.928203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927824+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:23:50.927824+0000","last_peered":"2024-04-26T02:23:50.927824+0000","last_clean":"2024-04-26T02:23:50.927824+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:23:50.927824+0000","last_undegraded":"2024-04-26T02:23:50.927824+0000","last_fullsized":"2024-04-26T02:23:50.927824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:04.893032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928324+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:23:51.928324+0000","last_peered":"2024-04-26T02:23:51.928324+0000","last_clean":"2024-04-26T02:23:51.928324+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:23:51.928324+0000","last_undegraded":"2024-04-26T02:23:51.928324+0000","last_fullsized":"2024-04-26T02:23:51.928324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.663311+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:23:51.663311+0000","last_peered":"2024-04-26T02:23:51.663311+0000","last_clean":"2024-04-26T02:23:51.663311+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:23:51.663311+0000","last_undegraded":"2024-04-26T02:23:51.663311+0000","last_fullsized":"2024-04-26T02:23:51.663311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:58.263438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'157","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.658303+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:23:51.658303+0000","last_peered":"2024-04-26T02:23:51.658303+0000","last_clean":"2024-04-26T02:23:51.658303+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:23:51.658303+0000","last_undegraded":"2024-04-26T02:23:51.658303+0000","last_fullsized":"2024-04-26T02:23:51.658303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215111,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215108,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,3,5,7,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[3,4,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280515,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280515,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[3,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[3,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215108,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:23:55.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:23:55.673 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:23:55.674 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:23:55.691 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-04-26T02:23:54.710539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":438404,"kb_used_data":5392,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509511036,"statfs":{"total":1546188226560,"available":1545739300864,"internally_reserved":0,"allocated":5521408,"data_stored":2808904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":442473555},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.787403"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928472+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:23:51.928472+0000","last_peered":"2024-04-26T02:23:51.928472+0000","last_clean":"2024-04-26T02:23:51.928472+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:23:51.928472+0000","last_undegraded":"2024-04-26T02:23:51.928472+0000","last_fullsized":"2024-04-26T02:23:51.928472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927558+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:23:50.927558+0000","last_peered":"2024-04-26T02:23:50.927558+0000","last_clean":"2024-04-26T02:23:50.927558+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:23:50.927558+0000","last_undegraded":"2024-04-26T02:23:50.927558+0000","last_fullsized":"2024-04-26T02:23:50.927558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.897763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:52.187055+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:23:52.187055+0000","last_peered":"2024-04-26T02:23:52.187055+0000","last_clean":"2024-04-26T02:23:52.187055+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:23:52.187055+0000","last_undegraded":"2024-04-26T02:23:52.187055+0000","last_fullsized":"2024-04-26T02:23:52.187055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.927825+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:23:51.927825+0000","last_peered":"2024-04-26T02:23:51.927825+0000","last_clean":"2024-04-26T02:23:51.927825+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:23:51.927825+0000","last_undegraded":"2024-04-26T02:23:51.927825+0000","last_fullsized":"2024-04-26T02:23:51.927825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928203+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:23:51.928203+0000","last_peered":"2024-04-26T02:23:51.928203+0000","last_clean":"2024-04-26T02:23:51.928203+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:23:51.928203+0000","last_undegraded":"2024-04-26T02:23:51.928203+0000","last_fullsized":"2024-04-26T02:23:51.928203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:50.927824+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:23:50.927824+0000","last_peered":"2024-04-26T02:23:50.927824+0000","last_clean":"2024-04-26T02:23:50.927824+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:23:50.927824+0000","last_undegraded":"2024-04-26T02:23:50.927824+0000","last_fullsized":"2024-04-26T02:23:50.927824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:04.893032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.928324+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:23:51.928324+0000","last_peered":"2024-04-26T02:23:51.928324+0000","last_clean":"2024-04-26T02:23:51.928324+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:23:51.928324+0000","last_undegraded":"2024-04-26T02:23:51.928324+0000","last_fullsized":"2024-04-26T02:23:51.928324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.663311+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:23:51.663311+0000","last_peered":"2024-04-26T02:23:51.663311+0000","last_clean":"2024-04-26T02:23:51.663311+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:23:51.663311+0000","last_undegraded":"2024-04-26T02:23:51.663311+0000","last_fullsized":"2024-04-26T02:23:51.663311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:58.263438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"1.0","version":"26'157","reported_seq":211,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-26T02:23:51.658303+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:23:51.658303+0000","last_peered":"2024-04-26T02:23:51.658303+0000","last_clean":"2024-04-26T02:23:51.658303+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:23:51.658303+0000","last_undegraded":"2024-04-26T02:23:51.658303+0000","last_fullsized":"2024-04-26T02:23:51.658303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215111,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215108,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215108,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313219,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,3,5,7,8,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":290816,"data_stored":116537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[3,4,5,6,7,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27300,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280515,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,5,6,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280515,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28256,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343584,"statfs":{"total":96636764160,"available":96607830016,"internally_reserved":0,"allocated":806912,"data_stored":636003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[3,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280515,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[3,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[3,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215108,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":107075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:23:55.692 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T02:23:55.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 28 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:fsid 83ecef7b-067c-41a4-8f83-dfa16b8b2690 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-04-26T02:23:33.724500+0000 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:modified 2024-04-26T02:23:51.919802+0000 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:crush_version 5 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:full_ratio 0.95 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:backfillfull_ratio 0.9 2024-04-26T02:23:55.981 INFO:teuthology.orchestra.run.smithi059.stdout:nearfull_ratio 0.85 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:require_min_compat_client luminous 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:min_compat_client jewel 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:require_osd_release squid 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:stretch_mode_enabled false 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 15.38 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rbd read_balance_score 5.95 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:max_osd 16 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6802/2847130092,v1:172.21.15.59:6803/2847130092] [v2:172.21.15.59:6804/2847130092,v1:172.21.15.59:6805/2847130092] exists,up 393355f7-165c-4b50-a42c-211810b715e4 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6809/504096392,v1:172.21.15.136:6813/504096392] [v2:172.21.15.136:6817/504096392,v1:172.21.15.136:6821/504096392] exists,up b2c35012-83a0-41ad-af28-9b6c78c491e6 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6800/785558131,v1:172.21.15.142:6801/785558131] [v2:172.21.15.142:6802/785558131,v1:172.21.15.142:6803/785558131] exists,up 5d88e67c-1ca1-4660-9cab-a609fce99a51 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/3691596427,v1:172.21.15.175:6801/3691596427] [v2:172.21.15.175:6802/3691596427,v1:172.21.15.175:6803/3691596427] exists,up 47b1c97a-90b1-4cf5-ad48-2a413f2469bd 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6819/2291404497,v1:172.21.15.59:6821/2291404497] [v2:172.21.15.59:6823/2291404497,v1:172.21.15.59:6825/2291404497] exists,up ae142bca-645a-48c1-ab55-d439ba3354e9 2024-04-26T02:23:55.982 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6810/3420144978,v1:172.21.15.136:6815/3420144978] [v2:172.21.15.136:6819/3420144978,v1:172.21.15.136:6823/3420144978] exists,up a1842799-b72b-4931-a839-253ac1b292d8 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6 up in weight 1 up_from 22 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6824/2443484296,v1:172.21.15.142:6825/2443484296] [v2:172.21.15.142:6826/2443484296,v1:172.21.15.142:6827/2443484296] exists,up 8281f789-0853-4359-8aaa-c9ec5795fd51 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/1727563740,v1:172.21.15.175:6809/1727563740] [v2:172.21.15.175:6810/1727563740,v1:172.21.15.175:6811/1727563740] exists,up 6c4063c6-1df9-4fb7-b29e-cdbebf121e3b 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8 up in weight 1 up_from 24 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6818/652278083,v1:172.21.15.59:6820/652278083] [v2:172.21.15.59:6822/652278083,v1:172.21.15.59:6824/652278083] exists,up 0b87d6f6-ee22-4c0b-83f7-2e97682943be 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/1522341187,v1:172.21.15.136:6802/1522341187] [v2:172.21.15.136:6804/1522341187,v1:172.21.15.136:6806/1522341187] exists,up fca5962a-8f15-4b46-a0be-570fa8cdb85a 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6808/2358058219,v1:172.21.15.142:6810/2358058219] [v2:172.21.15.142:6812/2358058219,v1:172.21.15.142:6813/2358058219] exists,up f2482c62-a013-4dfa-9270-e0d7163d8f3b 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/3853198939,v1:172.21.15.175:6825/3853198939] [v2:172.21.15.175:6826/3853198939,v1:172.21.15.175:6827/3853198939] exists,up c45ddf84-c385-4e2b-bc77-cc9a29dbee0b 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6810/753845278,v1:172.21.15.59:6811/753845278] [v2:172.21.15.59:6812/753845278,v1:172.21.15.59:6813/753845278] exists,up 3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6801/2997471095,v1:172.21.15.136:6803/2997471095] [v2:172.21.15.136:6805/2997471095,v1:172.21.15.136:6807/2997471095] exists,up b118541d-aac5-4ead-b469-142e5041a0e7 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6809/4003882581,v1:172.21.15.142:6811/4003882581] [v2:172.21.15.142:6814/4003882581,v1:172.21.15.142:6816/4003882581] exists,up 328780ca-719f-400f-ab8a-d74dd2e68111 2024-04-26T02:23:55.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] [v2:172.21.15.175:6818/1433451080,v1:172.21.15.175:6819/1433451080] exists,up 9bfe9d05-2d08-44e2-9eda-04d63f3cdf96 2024-04-26T02:23:55.999 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6802/2847130092,v1:172.21.15.59:6803/2847130092] [v2:172.21.15.59:6804/2847130092,v1:172.21.15.59:6805/2847130092] exists,up 393355f7-165c-4b50-a42c-211810b715e4', 'osd.1 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6809/504096392,v1:172.21.15.136:6813/504096392] [v2:172.21.15.136:6817/504096392,v1:172.21.15.136:6821/504096392] exists,up b2c35012-83a0-41ad-af28-9b6c78c491e6', 'osd.2 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6800/785558131,v1:172.21.15.142:6801/785558131] [v2:172.21.15.142:6802/785558131,v1:172.21.15.142:6803/785558131] exists,up 5d88e67c-1ca1-4660-9cab-a609fce99a51', 'osd.3 up in weight 1 up_from 21 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6800/3691596427,v1:172.21.15.175:6801/3691596427] [v2:172.21.15.175:6802/3691596427,v1:172.21.15.175:6803/3691596427] exists,up 47b1c97a-90b1-4cf5-ad48-2a413f2469bd', 'osd.4 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6819/2291404497,v1:172.21.15.59:6821/2291404497] [v2:172.21.15.59:6823/2291404497,v1:172.21.15.59:6825/2291404497] exists,up ae142bca-645a-48c1-ab55-d439ba3354e9', 'osd.5 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6810/3420144978,v1:172.21.15.136:6815/3420144978] [v2:172.21.15.136:6819/3420144978,v1:172.21.15.136:6823/3420144978] exists,up a1842799-b72b-4931-a839-253ac1b292d8', 'osd.6 up in weight 1 up_from 22 up_thru 23 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6824/2443484296,v1:172.21.15.142:6825/2443484296] [v2:172.21.15.142:6826/2443484296,v1:172.21.15.142:6827/2443484296] exists,up 8281f789-0853-4359-8aaa-c9ec5795fd51', 'osd.7 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6808/1727563740,v1:172.21.15.175:6809/1727563740] [v2:172.21.15.175:6810/1727563740,v1:172.21.15.175:6811/1727563740] exists,up 6c4063c6-1df9-4fb7-b29e-cdbebf121e3b', 'osd.8 up in weight 1 up_from 24 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6818/652278083,v1:172.21.15.59:6820/652278083] [v2:172.21.15.59:6822/652278083,v1:172.21.15.59:6824/652278083] exists,up 0b87d6f6-ee22-4c0b-83f7-2e97682943be', 'osd.9 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/1522341187,v1:172.21.15.136:6802/1522341187] [v2:172.21.15.136:6804/1522341187,v1:172.21.15.136:6806/1522341187] exists,up fca5962a-8f15-4b46-a0be-570fa8cdb85a', 'osd.10 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6808/2358058219,v1:172.21.15.142:6810/2358058219] [v2:172.21.15.142:6812/2358058219,v1:172.21.15.142:6813/2358058219] exists,up f2482c62-a013-4dfa-9270-e0d7163d8f3b', 'osd.11 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6824/3853198939,v1:172.21.15.175:6825/3853198939] [v2:172.21.15.175:6826/3853198939,v1:172.21.15.175:6827/3853198939] exists,up c45ddf84-c385-4e2b-bc77-cc9a29dbee0b', 'osd.12 up in weight 1 up_from 24 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.59:6810/753845278,v1:172.21.15.59:6811/753845278] [v2:172.21.15.59:6812/753845278,v1:172.21.15.59:6813/753845278] exists,up 3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2', 'osd.13 up in weight 1 up_from 22 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6801/2997471095,v1:172.21.15.136:6803/2997471095] [v2:172.21.15.136:6805/2997471095,v1:172.21.15.136:6807/2997471095] exists,up b118541d-aac5-4ead-b469-142e5041a0e7', 'osd.14 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6809/4003882581,v1:172.21.15.142:6811/4003882581] [v2:172.21.15.142:6814/4003882581,v1:172.21.15.142:6816/4003882581] exists,up 328780ca-719f-400f-ab8a-d74dd2e68111', 'osd.15 up in weight 1 up_from 22 up_thru 26 down_at 0 last_clean_interval [0,0) [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] [v2:172.21.15.175:6818/1433451080,v1:172.21.15.175:6819/1433451080] exists,up 9bfe9d05-2d08-44e2-9eda-04d63f3cdf96'] 2024-04-26T02:23:56.000 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T02:23:56.118 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:23:56.118 INFO:teuthology.orchestra.run.smithi059.stdout: "name": "mon.a", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster": "ceph", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "admin_socket_mode": "", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_client_required": "cephx, none", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_cluster_required": "cephx", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_debug": "true", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_service_required": "cephx", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_supported": "cephx", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio": "true", 2024-04-26T02:23:56.119 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_aio_reap_max": "16", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_async_discard": "false", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_block_size": "4096", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_aio": "false", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_enable_discard": "false", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_flock_retry": "3", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_inject_crash": "0", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_ioring": "false", 2024-04-26T02:23:56.120 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_ioring_hipri": "false", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bdev_type": "", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_allocator": "hybrid", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_buffered_io": "true", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T02:23:56.121 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_replay_recovery": "false", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs_sync_write": "false", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_allocator": "hybrid", 2024-04-26T02:23:56.122 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_create": "true", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_db_create": "false", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_db_path": "", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_db_size": "0", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_path": "", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_size": "107374182400", 2024-04-26T02:23:56.123 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_wal_create": "false", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_wal_path": "", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs": "true", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_autotune": "true", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T02:23:56.124 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_size": "0", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cache_type": "2q", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_clone_cow": "true", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T02:23:56.125 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_mode": "none", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_freelist": "false", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T02:23:56.126 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T02:23:56.127 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fail_eio": "false", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T02:23:56.128 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T02:23:56.129 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_blob_size": "0", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T02:23:56.130 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_spdk_mem": "512", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T02:23:56.131 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_tracing": "false", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T02:23:56.132 INFO:teuthology.orchestra.run.smithi059.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T02:23:56.133 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_cluster_require_version": "2", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_require_signatures": "false", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_require_version": "2", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_service_require_signatures": "false", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_service_require_version": "2", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "cephx_sign_messages": "true", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "chdir": "", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_acl_type": "", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_asio_thread_count": "2", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_cache_mid": "0.750000", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_cache_size": "16384", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_caps_release_delay": "5", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_check_pool_perm": "true", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_debug_force_sync_read": "false", 2024-04-26T02:23:56.134 INFO:teuthology.orchestra.run.smithi059.stdout: "client_debug_getattr_caps": "false", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_die_on_failed_remount": "false", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_dirsize_rbytes": "true", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_force_lazyio": "false", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_fs": "", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_inject_release_failure": "false", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_max_inline_size": "4096", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mds_namespace": "", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_metadata": "", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mount_gid": "-1", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mount_timeout": "300", 2024-04-26T02:23:56.135 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mount_uid": "-1", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_mountpoint": "/", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_notify_timeout": "10", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc": "true", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_max_objects": "1000", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_size": "209715200", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_permissions": "true", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_quota": "true", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_quota_df": "true", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_readahead_max_bytes": "0", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_readahead_max_periods": "4", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_readahead_min": "131072", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_reconnect_stale": "false", 2024-04-26T02:23:56.136 INFO:teuthology.orchestra.run.smithi059.stdout: "client_shutdown_timeout": "30", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_snapdir": ".snap", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_tick_interval": "1", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_trace": "", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_use_faked_inos": "false", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_use_random_mds": "false", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_graylog": "false", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_graylog_port": "12201", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_monitors": "default=true", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_syslog": "false", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "clog_to_syslog_level": "info", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_addr": "-", 2024-04-26T02:23:56.137 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_network": "", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_network_interface": "", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zlib_isal": "false", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zlib_level": "5", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "compressor_zstd_level": "1", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crimson_seastar_cpu_cores": "", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_location": "", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_location_hook": "", 2024-04-26T02:23:56.138 INFO:teuthology.orchestra.run.smithi059.stdout: "crush_location_hook_timeout": "10", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "daemonize": "false", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "daos_pool": "tank", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_alienstore": "0/5", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_asok": "1/5", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_asok_assert_abort": "false", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_auth": "20/20", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_bdev": "1/3", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_bluefs": "1/5", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_bluestore": "1/5", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_buffer": "0/1", 2024-04-26T02:23:56.139 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_cephsqlite": "0/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_client": "0/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_compressor": "1/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_context": "0/1", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_crimson_interrupt": "0/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_crush": "1/1", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_crypto": "1/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_cyanstore": "0/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_dpdk": "1/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_eventtrace": "1/5", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_filer": "0/1", 2024-04-26T02:23:56.140 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_filestore": "1/3", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_finisher": "1/1", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_fuse": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_javaclient": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_journal": "1/3", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_journaler": "0/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_kstore": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_lockdep": "0/1", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mclock": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_balancer": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_locker": "1/5", 2024-04-26T02:23:56.141 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_log": "1/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_migrator": "1/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mds_quiesce": "3/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_memstore": "1/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mgr": "2/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mgrc": "1/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_mon": "20/20", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_monc": "0/10", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_ms": "1/1", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_none": "0/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_objclass": "0/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_objectcacher": "0/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_objecter": "0/1", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_optracker": "0/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_osd": "1/5", 2024-04-26T02:23:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_paxos": "20/20", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_perfcounter": "1/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_prioritycache": "1/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rados": "0/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd": "0/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rbd_replay": "0/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_refs": "0/0", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_reserver": "1/1", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw": "1/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_access": "1/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_flight": "1/5", 2024-04-26T02:23:56.143 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rgw_sync": "1/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_rocksdb": "4/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_backref": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_cache": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_device": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_epm": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_journal": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_lba": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_odata": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_omap": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_onode": "0/5", 2024-04-26T02:23:56.144 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_t": "0/5", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_seastore_tm": "0/5", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_striper": "0/1", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_test": "0/5", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_throttle": "1/1", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_timer": "0/1", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_tp": "0/5", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "debug_trace": "1/5", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "device_failure_prediction_mode": "none", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T02:23:56.145 INFO:teuthology.orchestra.run.smithi059.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_graylog": "false", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_journald": "false", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_stderr": "true", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "err_to_syslog": "false", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event_tracing": "false", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_http_port": "9926", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_prio_limit": "5", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_sort_metrics": "true", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "exporter_stats_period": "5", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "fake_statfs_for_testing": "0", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "fatal_signal_handlers": "true", 2024-04-26T02:23:56.146 INFO:teuthology.orchestra.run.smithi059.stdout: "filer_max_purge_ops": "10", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filer_max_truncate_ops": "128", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_blackhole": "false", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_btrfs_snap": "true", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_caller_concurrency": "10", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_debug_omap_check": "false", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_debug_verify_split": "false", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_dump_file": "", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T02:23:56.147 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fadvise": "true", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fail_eio": "true", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fd_cache_size": "128", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fiemap": "false", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_inject_stall": "0", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_journal_parallel": "false", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_journal_trailing": "false", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_journal_writeahead": "false", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_kill_at": "0", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T02:23:56.148 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_merge_threshold": "-10", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_odsync_write": "false", 2024-04-26T02:23:56.149 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_omap_backend_path": "", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_op_threads": "2", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_punch_hole": "false", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T02:23:56.150 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_queue_max_ops": "50", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_seek_data_hole": "false", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_sloppy_crc": "false", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_splice": "false", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_split_multiple": "2", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_split_rand_factor": "20", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_update_to": "1000", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T02:23:56.151 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_xfs_extsize": "false", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "filestore_zfs_snap": "false", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "fio_dir": "/tmp/fio", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "fsid": "83ecef7b-067c-41a4-8f83-dfa16b8b2690", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_allow_other": "true", 2024-04-26T02:23:56.152 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_big_writes": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_debug": "false", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_default_permissions": "false", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_disable_pagecache": "false", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_max_write": "0", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_multithreaded": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_require_active_mds": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_set_user_groups": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_splice_move": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_splice_read": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_splice_write": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "gss_target_name": "ceph", 2024-04-26T02:23:56.153 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_file": "", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_inject_failure": "0", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "heartbeat_interval": "5", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "host": "smithi059", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T02:23:56.154 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "inject_early_sigterm": "false", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "jaeger_agent_port": "6799", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "jaeger_tracing_enable": "false", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_aio": "true", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_align_min_size": "65536", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_block_align": "true", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_block_size": "4096", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_dio": "true", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_discard": "false", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_force_aio": "false", 2024-04-26T02:23:56.155 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_ignore_corruption": "false", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_max_write_entries": "100", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_replay_from": "0", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_write_header_frequency": "0", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journal_zero_on_create": "false", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journaler_prefetch_periods": "10", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journaler_prezero_periods": "5", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "journaler_write_head_interval": "15", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "keyfile": "", 2024-04-26T02:23:56.156 INFO:teuthology.orchestra.run.smithi059.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_backend": "rocksdb", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_max_bytes": "67108864", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_max_ops": "512", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_onode_map_size": "1024", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "kstore_sync_transaction": "false", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "librados_thread_count": "2", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "lockdep": "false", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "lockdep_force_backtrace": "false", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "log_coarse_timestamps": "true", 2024-04-26T02:23:56.157 INFO:teuthology.orchestra.run.smithi059.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_flush_on_exit": "false", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_graylog_port": "12201", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_max_new": "1000", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_max_recent": "10000", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_stderr_prefix": "", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_file": "true", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_graylog": "false", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_journald": "false", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_stderr": "false", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "log_to_syslog": "false", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T02:23:56.158 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_action_on_write_error": "1", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_alternate_name_max": "8192", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_asio_thread_count": "2", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_export_pin": "true", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_interval": "10", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_max": "-1", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_max_until": "-1", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_merge_size": "50", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T02:23:56.159 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_mode": "0", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_overload_epochs": "2", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_bits": "3", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_size": "10000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T02:23:56.160 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_mid": "0.700000", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_delay": "0", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_trim_interval": "1", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T02:23:56.161 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_auth_pins": "false", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_frag": "false", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_scatterstat": "false", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_debug_subtrees": "false", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_default_dir_hash": "2", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_defer_session_stale": "true", 2024-04-26T02:23:56.162 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_max_entries": "0", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dir_prefetch": "true", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_early_reply": "true", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_enable_op_tracker": "true", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_enforce_unique_name": "true", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T02:23:56.163 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_health_dummy": "false", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T02:23:56.164 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_join_fs": "", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_journal_format": "1", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_create_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_export_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_import_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_journal_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_link_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_openc_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_rename_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_shutdown_at": "0", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T02:23:56.165 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_event_large_threshold": "524288", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_max_events": "-1", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_max_segments": "128", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_pause": "false", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_segment_size": "0", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_trim_threshold": "128", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T02:23:56.166 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_completed_requests": "100000", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_export_size": "20971520", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_file_recover": "32", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_purge_files": "64", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_purge_ops": "8192", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_metrics_update_interval": "2", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_min_caps_per_client": "100", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_numa_node": "-1", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T02:23:56.167 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_duration": "600", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_size": "20", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_op_log_threshold": "5", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_ping_grace": "15", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_ping_interval": "5", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_max_caps": "30000", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T02:23:56.168 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_replay_interval": "1.000000", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_root_ino_gid": "0", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_root_ino_uid": "0", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T02:23:56.169 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_shutdown_check": "0", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_skip_ino": "0", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_snap_min_uid": "0", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_snap_rstat": "false", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_symlink_recovery": "true", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_thrash_exports": "0", 2024-04-26T02:23:56.170 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_thrash_fragments": "0", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_tick_interval": "5.000000", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_valgrind_exit": "false", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_verify_backtrace": "1", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_verify_scatter": "false", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_wipe_sessions": "false", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mempool_debug": "false", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_page_set": "false", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "memstore_page_size": "65536", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_client_bytes": "134217728", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_client_messages": "512", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T02:23:56.171 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_disabled_modules": "", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mds_messages": "128", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_mon_messages": "128", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_osd_messages": "8192", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_pool": "true", 2024-04-26T02:23:56.172 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_standby_modules": "true", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_stats_period": "5", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_stats_threshold": "5", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_tick_period": "2", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_allow_pool_delete": "true", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_bytes": "104857600", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_directed_command_retry": "5", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T02:23:56.173 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_client_target_rank": "-1", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T02:23:56.174 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_compact_on_start": "false", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_compact_on_trim": "true", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_cpu_threads": "4", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T02:23:56.175 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data_avail_crit": "5", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data_avail_warn": "5", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_dump_json": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_extra_checks": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_no_require_squid": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T02:23:56.176 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_down_uptime_grace": "60", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_election_default_strategy": "3", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_election_timeout": "5.000000", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_enable_op_tracker": "true", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_fake_pool_delete": "false", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_force_quorum_join": "false", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_log_update_period": "5", 2024-04-26T02:23:56.177 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_max_detail": "50", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_to_clog": "true", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_host": "172.21.15.59,172.21.15.136,172.21.15.142", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_host_override": "", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_initial_members": "", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_lease": "5.000000", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T02:23:56.178 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_log_full_interval": "50", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_log_max": "10000", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_log_max_summary": "50", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_log_epochs": "500", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_osd": "10000", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T02:23:56.179 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_memory_autotune": "true", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_memory_target": "2147483648", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_digest_period": "5", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_complaint_time": "30", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_duration": "600", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_size": "20", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T02:23:56.180 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_op_log_threshold": "5", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_cache_size": "500", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T02:23:56.181 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T02:23:56.182 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_report_timeout": "900", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T02:23:56.183 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_max_osds": "4", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_interval": "300", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_max_keys": "100", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_scrub_timeout": "300", 2024-04-26T02:23:56.184 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_session_timeout": "300", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_smart_report_timeout": "5", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_pool_size": "4", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_debug": "false", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T02:23:56.185 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_tick_interval": "5", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_older_version": "true", 2024-04-26T02:23:56.186 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "monmap": "", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T02:23:56.187 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "motr_tracing_enabled": "false", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_op_threads": "3", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_cm": "false", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_device_name": "", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T02:23:56.188 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_sl": "3", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_rdma_type": "ib", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_async_reap_threshold": "5", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_before_connect": "false", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_ipv4": "true", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_ipv6": "false", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_msgr1": "true", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_msgr2": "true", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_port_max": "7568", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_port_min": "6800", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_retry_count": "3", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_bind_retry_delay": "5", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_client": "false", 2024-04-26T02:23:56.189 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_mds": "false", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_mgr": "false", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_mon": "false", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_blackhole_osd": "false", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_client_mode": "crc secure", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_cluster_type": "", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_compress_secure": "false", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_crc_data": "true", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_crc_header": "true", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_bug": "true", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_old_message": "true", 2024-04-26T02:23:56.190 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_hugepages": "", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T02:23:56.191 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_lro": "true", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_pmd": "", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_port_id": "0", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_dump_on_send": "false", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_delay_type": "", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_network_congestion": "0", 2024-04-26T02:23:56.192 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_inject_socket_failures": "2500", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_max_accept_failures": "4", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_max_backoff": "15.000000", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_osd_compress_mode": "none", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_pq_min_cost": "65536", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_public_type": "", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_service_mode": "crc secure", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T02:23:56.193 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_nodelay": "true", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "ms_type": "async+posix", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "no_config_file": "false", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_inflight_ops": "1024", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objecter_timeout": "10.000000", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objectstore_blackhole": "false", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-26T02:23:56.194 INFO:teuthology.orchestra.run.smithi059.stdout: "openssl_engine_opts": "", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_max_ops": "4", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_agent_slop": "0.020000", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_asio_thread_count": "2", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backfill_scan_max": "512", 2024-04-26T02:23:56.195 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backfill_scan_min": "64", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backoff_on_peering": "false", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_beacon_report_interval": "300", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_duration": "30", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_blkin_trace_all": "false", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T02:23:56.196 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_class_update_on_start": "true", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_message_cap": "256", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_op_priority": "63", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_client_watch_timeout": "30", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_command_max_records": "256", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_compact_on_start": "false", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_update_on_start": "true", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T02:23:56.197 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_op_order": "false", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T02:23:56.198 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_shutdown": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_trim_objects": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T02:23:56.199 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_default_notify_timeout": "30", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_enable_op_tracker": "true", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T02:23:56.200 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_info": "true", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_shutdown": "true", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_function_tracing": "false", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_grace": "20", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_interval": "6", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_stale": "600", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T02:23:56.201 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_journal_size": "5120", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_kill_backfill_at": "0", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_cache_size": "50", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_dedup": "true", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_message_max": "40", 2024-04-26T02:23:56.202 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_attr_name_len": "100", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_attr_size": "0", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_backfills": "1", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_markdown_count": "5", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_markdown_period": "600", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_object_name_len": "2048", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_object_size": "134217728", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T02:23:56.203 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_pgls": "1024", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_push_cost": "8388608", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_push_objects": "10", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_scrubs": "3", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_max_write_size": "90", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T02:23:56.204 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_profile": "balanced", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_base": "805306368", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T02:23:56.205 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T02:23:56.206 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T02:23:56.206 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_target": "4294967296", 2024-04-26T02:23:56.206 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_target_autotune": "false", 2024-04-26T02:23:56.206 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T02:23:56.206 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T02:23:56.207 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_min_recovery_priority": "0", 2024-04-26T02:23:56.207 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T02:23:56.207 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T02:23:56.207 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_report_interval": "5", 2024-04-26T02:23:56.207 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T02:23:56.207 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T02:23:56.207 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_num_cache_shards": "32", 2024-04-26T02:23:56.208 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T02:23:56.208 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T02:23:56.208 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_numa_node": "-1", 2024-04-26T02:23:56.208 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T02:23:56.208 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T02:23:56.208 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objecter_finishers": "1", 2024-04-26T02:23:56.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objectstore": "bluestore", 2024-04-26T02:23:56.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objectstore_fuse": "false", 2024-04-26T02:23:56.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_objectstore_tracing": "false", 2024-04-26T02:23:56.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T02:23:56.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_duration": "600", 2024-04-26T02:23:56.209 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_size": "20", 2024-04-26T02:23:56.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T02:23:56.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T02:23:56.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_log_threshold": "5", 2024-04-26T02:23:56.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_shards": "0", 2024-04-26T02:23:56.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T02:23:56.210 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T02:23:56.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T02:23:56.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T02:23:56.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T02:23:56.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T02:23:56.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T02:23:56.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T02:23:56.211 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T02:23:56.212 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T02:23:56.212 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_op_thread_timeout": "15", 2024-04-26T02:23:56.212 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_open_classes_on_start": "true", 2024-04-26T02:23:56.212 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_os_flags": "0", 2024-04-26T02:23:56.212 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_peering_op_priority": "255", 2024-04-26T02:23:56.212 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T02:23:56.212 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_delete_priority": "5", 2024-04-26T02:23:56.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T02:23:56.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T02:23:56.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T02:23:56.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T02:23:56.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T02:23:56.213 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T02:23:56.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T02:23:56.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-26T02:23:56.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-26T02:23:56.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T02:23:56.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T02:23:56.214 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T02:23:56.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T02:23:56.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T02:23:56.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T02:23:56.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_crimson": "false", 2024-04-26T02:23:56.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T02:23:56.215 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T02:23:56.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T02:23:56.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T02:23:56.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T02:23:56.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T02:23:56.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T02:23:56.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T02:23:56.216 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_flags": "0", 2024-04-26T02:23:56.217 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T02:23:56.217 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_min_size": "0", 2024-04-26T02:23:56.217 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T02:23:56.217 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T02:23:56.217 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T02:23:56.217 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T02:23:56.218 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_read_ratio": "70", 2024-04-26T02:23:56.218 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_size": "2", 2024-04-26T02:23:56.218 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_default_type": "replicated", 2024-04-26T02:23:56.218 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T02:23:56.218 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T02:23:56.218 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T02:23:56.219 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T02:23:56.219 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T02:23:56.219 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T02:23:56.219 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_cost": "20971520", 2024-04-26T02:23:56.219 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T02:23:56.219 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_active": "0", 2024-04-26T02:23:56.219 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T02:23:56.220 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T02:23:56.220 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T02:23:56.220 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T02:23:56.220 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T02:23:56.220 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_op_priority": "3", 2024-04-26T02:23:56.220 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T02:23:56.221 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_priority": "5", 2024-04-26T02:23:56.221 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T02:23:56.221 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T02:23:56.221 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T02:23:56.221 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T02:23:56.221 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T02:23:56.222 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_repair_during_recovery": "false", 2024-04-26T02:23:56.222 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T02:23:56.222 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T02:23:56.222 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T02:23:56.222 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T02:23:56.222 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T02:23:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T02:23:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T02:23:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T02:23:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T02:23:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T02:23:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_cost": "52428800", 2024-04-26T02:23:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-26T02:23:56.224 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T02:23:56.224 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_end_hour": "0", 2024-04-26T02:23:56.224 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T02:23:56.224 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T02:23:56.224 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T02:23:56.224 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T02:23:56.225 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T02:23:56.225 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T02:23:56.225 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T02:23:56.225 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T02:23:56.225 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T02:23:56.225 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_priority": "5", 2024-04-26T02:23:56.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T02:23:56.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T02:23:56.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T02:23:56.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T02:23:56.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_skip_data_digest": "false", 2024-04-26T02:23:56.226 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_smart_report_timeout": "5", 2024-04-26T02:23:56.227 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T02:23:56.227 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_priority": "5", 2024-04-26T02:23:56.227 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T02:23:56.227 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T02:23:56.227 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T02:23:56.227 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T02:23:56.227 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T02:23:56.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T02:23:56.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T02:23:56.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_target_transaction_size": "30", 2024-04-26T02:23:56.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T02:23:56.228 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_tracing": "false", 2024-04-26T02:23:56.229 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_use_stale_snap": "false", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_kill_at": "0", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_max_join_drift": "10", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_min": "500", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_min_wait": "0.050000", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_service_trim_max": "500", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T02:23:56.230 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_service_trim_min": "250", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_stash_full_interval": "25", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_trim_max": "500", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "paxos_trim_min": "250", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "perf": "true", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addr": "-", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "public_addrv": "", 2024-04-26T02:23:56.231 INFO:teuthology.orchestra.run.smithi059.stdout: "public_bind_addr": "-", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "public_network": "", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "public_network_interface": "", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "qat_compressor_enabled": "false", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "rados_mon_op_timeout": "0", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "rados_osd_op_timeout": "0", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "rados_tracing": "false", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_atime_update_interval": "60", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T02:23:56.232 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache": "true", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_policy": "writearound", 2024-04-26T02:23:56.233 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_size": "33554432", 2024-04-26T02:23:56.234 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T02:23:56.234 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T02:23:56.234 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T02:23:56.234 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_compression_hint": "none", 2024-04-26T02:23:56.234 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T02:23:56.234 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T02:23:56.234 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_clone_format": "auto", 2024-04-26T02:23:56.235 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_data_pool": "", 2024-04-26T02:23:56.235 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_features": "61", 2024-04-26T02:23:56.235 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_format": "2", 2024-04-26T02:23:56.237 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_map_options": "", 2024-04-26T02:23:56.237 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_order": "22", 2024-04-26T02:23:56.237 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_pool": "rbd", 2024-04-26T02:23:56.237 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_stripe_count": "0", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T02:23:56.238 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_io_scheduler": "simple", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T02:23:56.239 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T02:23:56.240 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T02:23:56.240 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_order": "24", 2024-04-26T02:23:56.240 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_pool": "", 2024-04-26T02:23:56.240 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_journal_splay_width": "4", 2024-04-26T02:23:56.240 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T02:23:56.240 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T02:23:56.240 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T02:23:56.241 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T02:23:56.241 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T02:23:56.241 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T02:23:56.241 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T02:23:56.241 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T02:23:56.241 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T02:23:56.241 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T02:23:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T02:23:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T02:23:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T02:23:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T02:23:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T02:23:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T02:23:56.242 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T02:23:56.243 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T02:23:56.243 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T02:23:56.243 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T02:23:56.243 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T02:23:56.243 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T02:23:56.243 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T02:23:56.243 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T02:23:56.244 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T02:23:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T02:23:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T02:23:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T02:23:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_op_threads": "1", 2024-04-26T02:23:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T02:23:56.245 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T02:23:56.246 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T02:23:56.246 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T02:23:56.246 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_plugins": "", 2024-04-26T02:23:56.246 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T02:23:56.246 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T02:23:56.246 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T02:23:56.246 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T02:23:56.247 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T02:23:56.247 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T02:23:56.247 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T02:23:56.247 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T02:23:56.247 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T02:23:56.247 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T02:23:56.248 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T02:23:56.248 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T02:23:56.248 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T02:23:56.248 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T02:23:56.249 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_tracing": "false", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_validate_names": "true", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rbd_validate_pool": "true", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "restapi_base_url": "", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "restapi_log_level": "", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_admin_entry": "admin", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_backend_store": "rados", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_barbican_url": "", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_beast_enable_async": "true", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_counters_cache": "false", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-26T02:23:56.250 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cache_enabled": "true", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_config_store": "rados", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_content_length_compat": "false", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T02:23:56.251 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_cross_domain_policy": "", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T02:23:56.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T02:23:56.253 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T02:23:56.254 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-26T02:23:56.255 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_d4n_port": "6379", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_log_window": "30", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T02:23:56.256 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T02:23:56.257 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dns_name": "", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dns_s3website_name": "", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_ops_log": "false", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T02:23:56.258 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_static_website": "false", 2024-04-26T02:23:56.259 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enable_usage_log": "false", 2024-04-26T02:23:56.259 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T02:23:56.259 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T02:23:56.259 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_expose_bucket": "false", 2024-04-26T02:23:56.259 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_extended_http_attrs": "", 2024-04-26T02:23:56.259 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_filter": "none", 2024-04-26T02:23:56.259 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T02:23:56.260 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T02:23:56.260 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T02:23:56.260 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T02:23:56.260 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T02:23:56.260 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_objs": "32", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_init_timeout": "300", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_kafka_connection_idle": "300", 2024-04-26T02:23:56.261 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_password": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_project": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_token": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_admin_user": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_api_version": "2", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T02:23:56.262 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_url": "", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_objs": "32", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T02:23:56.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_worker": "3", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ldap_uri": "", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_http_headers": "", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T02:23:56.264 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_attr_size": "0", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_listing_results": "1000", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_notify_retries": "10", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T02:23:56.265 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T02:23:56.266 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_num_control_oids": "8", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_numa_node": "-1", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T02:23:56.267 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_op_tracing": "false", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_opa_token": "", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_opa_url": "", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_rados": "false", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T02:23:56.268 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_lanes": "3", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_cache_partitions": "3", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_print_continue": "true", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T02:23:56.269 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rados_tracing": "false", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_realm": "", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_realm_id": "", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_region": "", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_request_uri": "", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T02:23:56.270 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_resolve_cname": "false", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_run_sync_thread": "true", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T02:23:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_script_uri": "", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_service_provider_name": "", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_client_id": "", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_client_secret": "", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_entry": "sts", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_key": "sts", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_auth_url": "", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_custom_header": "", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T02:23:56.272 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_need_stats": "true", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_tenant_name": "", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_url": "", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_lease_period": "120", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T02:23:56.273 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T02:23:56.274 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T02:23:56.274 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_thread_pool_size": "512", 2024-04-26T02:23:56.274 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-26T02:23:56.274 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-26T02:23:56.274 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-26T02:23:56.274 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-26T02:23:56.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_comment": "", 2024-04-26T02:23:56.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_createby": "", 2024-04-26T02:23:56.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_encoding": "", 2024-04-26T02:23:56.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_flag": "false", 2024-04-26T02:23:56.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-26T02:23:56.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_origin": "", 2024-04-26T02:23:56.275 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T02:23:56.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_torrent_tracker": "", 2024-04-26T02:23:56.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T02:23:56.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T02:23:56.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T02:23:56.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_max_shards": "32", 2024-04-26T02:23:56.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T02:23:56.276 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_use_opa_authz": "false", 2024-04-26T02:23:56.277 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_counters_cache": "false", 2024-04-26T02:23:56.277 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-26T02:23:56.277 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T02:23:56.277 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T02:23:56.277 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T02:23:56.277 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T02:23:56.277 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T02:23:56.278 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T02:23:56.278 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T02:23:56.278 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T02:23:56.278 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_user_unique_email": "true", 2024-04-26T02:23:56.278 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_verify_ssl": "true", 2024-04-26T02:23:56.278 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T02:23:56.279 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zone": "", 2024-04-26T02:23:56.279 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zone_id": "", 2024-04-26T02:23:56.279 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T02:23:56.279 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zonegroup": "", 2024-04-26T02:23:56.279 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zonegroup_id": "", 2024-04-26T02:23:56.279 INFO:teuthology.orchestra.run.smithi059.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T02:23:56.279 INFO:teuthology.orchestra.run.smithi059.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T02:23:56.280 INFO:teuthology.orchestra.run.smithi059.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T02:23:56.280 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_block_size": "4096", 2024-04-26T02:23:56.280 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T02:23:56.280 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T02:23:56.280 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T02:23:56.280 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T02:23:56.280 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T02:23:56.281 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T02:23:56.281 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T02:23:56.281 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T02:23:56.281 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T02:23:56.281 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T02:23:56.281 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T02:23:56.282 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T02:23:56.282 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T02:23:56.282 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T02:23:56.282 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T02:23:56.282 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T02:23:56.282 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T02:23:56.282 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_partition_filters": "false", 2024-04-26T02:23:56.283 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_perf": "false", 2024-04-26T02:23:56.283 INFO:teuthology.orchestra.run.smithi059.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T02:23:56.283 INFO:teuthology.orchestra.run.smithi059.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T02:23:56.283 INFO:teuthology.orchestra.run.smithi059.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T02:23:56.283 INFO:teuthology.orchestra.run.smithi059.stdout: "run_dir": "/var/run/ceph", 2024-04-26T02:23:56.283 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_block_create": "true", 2024-04-26T02:23:56.283 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T02:23:56.284 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T02:23:56.284 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-26T02:23:56.284 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T02:23:56.284 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T02:23:56.284 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_device_size": "53687091200", 2024-04-26T02:23:56.284 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T02:23:56.285 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T02:23:56.285 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T02:23:56.285 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T02:23:56.285 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_main_device_type": "SSD", 2024-04-26T02:23:56.285 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T02:23:56.285 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T02:23:56.285 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T02:23:56.286 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T02:23:56.286 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T02:23:56.286 INFO:teuthology.orchestra.run.smithi059.stdout: "seastore_segment_size": "67108864", 2024-04-26T02:23:56.286 INFO:teuthology.orchestra.run.smithi059.stdout: "set_keepcaps": "false", 2024-04-26T02:23:56.286 INFO:teuthology.orchestra.run.smithi059.stdout: "setgroup": "", 2024-04-26T02:23:56.286 INFO:teuthology.orchestra.run.smithi059.stdout: "setuser": "", 2024-04-26T02:23:56.287 INFO:teuthology.orchestra.run.smithi059.stdout: "setuser_match_path": "", 2024-04-26T02:23:56.287 INFO:teuthology.orchestra.run.smithi059.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T02:23:56.287 INFO:teuthology.orchestra.run.smithi059.stdout: "thp": "false", 2024-04-26T02:23:56.287 INFO:teuthology.orchestra.run.smithi059.stdout: "threadpool_default_timeout": "60", 2024-04-26T02:23:56.287 INFO:teuthology.orchestra.run.smithi059.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T02:23:56.287 INFO:teuthology.orchestra.run.smithi059.stdout: "throttler_perf_counter": "true" 2024-04-26T02:23:56.287 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:23:56.291 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T02:23:56.445 INFO:teuthology.orchestra.run.smithi059.stdout:mon.a: {} 2024-04-26T02:23:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T02:23:56.458 INFO:teuthology.orchestra.run.smithi059.stdout:mon.b: {} 2024-04-26T02:23:56.458 INFO:teuthology.orchestra.run.smithi059.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T02:23:56.472 INFO:teuthology.orchestra.run.smithi059.stdout:mon.c: {} 2024-04-26T02:23:56.472 INFO:teuthology.orchestra.run.smithi059.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T02:23:56.488 DEBUG:teuthology.orchestra.run.smithi059:> type ceph-objectstore-tool 2024-04-26T02:23:56.492 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T02:23:56.492 DEBUG:teuthology.orchestra.run.smithi136:> type ceph-objectstore-tool 2024-04-26T02:23:56.498 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T02:23:56.498 DEBUG:teuthology.orchestra.run.smithi142:> type ceph-objectstore-tool 2024-04-26T02:23:56.504 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T02:23:56.504 DEBUG:teuthology.orchestra.run.smithi175:> type ceph-objectstore-tool 2024-04-26T02:23:56.509 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T02:23:56.510 INFO:teuthology.run_tasks:Running task rados... 2024-04-26T02:23:56.521 INFO:tasks.rados:Beginning rados... 2024-04-26T02:23:56.521 DEBUG:teuthology.run_tasks:Unwinding manager rados 2024-04-26T02:23:56.530 INFO:tasks.rados:joining rados 2024-04-26T02:23:56.530 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T02:23:56.530 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:23:56.530 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:23:56.530 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T02:23:56.531 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T02:23:56.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:23:56.531 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T02:23:56.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:23:56.532 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T02:23:56.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T02:23:56.532 INFO:tasks.rados:clients are ['client.0'] 2024-04-26T02:23:56.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set shecprofile c=2 crush-failure-domain=osd k=4 m=3 name=shecprofile plugin=shec 2024-04-26T02:23:56.539 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:23:56.536+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:23:56.633 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:56.632+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:23:56.655 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:23:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:23:56.655 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:23:56.655 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:23:56.670 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:23:56.678 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:23:56.679 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:23:56.699 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:23:56.699 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:23:56.720 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:23:56.720 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:23:56.733 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:23:56.729+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:23:56.755 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:23:56.755 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:23:56.777 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:23:56.777 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:23:56.783 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:56.783 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:56.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:23:56.798 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:23:56.798 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:23:56.819 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:23:56.819 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:23:56.838 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:23:56.835+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:23:56.839 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:23:56.839 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:23:56.857 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:23:56.857 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:23:56.878 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:23:56.879 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:23:56.898 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:23:56.899 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:23:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:56.909 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:56.919 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:23:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:23:56.922 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:23:56.936 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:23:56.932+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:23:56.937 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:23:56.937 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:23:56.951 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-04-26T02:23:56.952 INFO:teuthology.orchestra.run.smithi059.stderr:load: shec 2024-04-26T02:23:56.959 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:23:56.959 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:23:56.980 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:23:56.980 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:23:56.981 INFO:tasks.rados:starting run 0 out of 1 2024-04-26T02:23:56.981 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-26T02:23:56.982 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 16 erasure shecprofile 2024-04-26T02:23:56.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:23:56.981+0000 7f1df4d24640 0 -- 172.21.15.59:0/2592250395 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f1df0224560 msgr2=0x7f1df02269b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:23:57.003 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:23:57.004 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:23:57.062 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:57.063 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:57.063 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:23:57.061+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:23:57.076 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:23:57.139 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:23:57.139+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:23:57.229 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:57.229 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:57.240 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:57.236+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:23:57.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:23:57.342 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:23:57.340+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:23:57.352 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:57.352 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:57.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:23:57.443 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:23:57.441+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:23:57.487 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:57.545 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:57.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:23:57.548 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:57.544+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:23:57.647 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:23:57.647+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:23:57.719 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:57.719 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:57.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:23:57.748 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:23:57.744+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:23:57.849 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:23:57.845+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:23:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:57.853 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:57.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:23:57.951 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:23:57.951+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:23:58.037 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:58.038 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:58.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:23:58.052 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:58.048+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:23:58.154 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:23:58.152+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:23:58.170 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:58.170 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:58.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:23:58.255 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:58.252+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:23:58.304 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:58.304 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:58.318 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:23:58.355 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:23:58.353+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:23:58.450 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:58.451 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:58.456 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:23:58.455+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:23:58.465 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:23:58.557 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:23:58.553+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:23:58.583 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:58.583 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:58.599 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:23:58.658 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:58.652+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:23:58.723 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:58.723 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:58.737 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:23:58.779 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:58.776+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:23:58.861 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:58.856+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:23:58.899 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:58.900 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:58.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:23:58.962 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:23:58.960+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:23:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'unique_pool_0' created 2024-04-26T02:23:58.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T02:23:59.003 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-26T02:23:59.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:23:59.062 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:23:59.056+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:23:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:59.083 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:59.097 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:23:59.163 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:59.160+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:23:59.206 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:23:59.206 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:23:59.241 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:23:59.241 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:23:59.262 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:59.262 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:59.264 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:23:59.260+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:23:59.276 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:23:59.277 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:23:59.277 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:23:59.312 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:23:59.313 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:23:59.330 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:23:59.330 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:23:59.348 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:23:59.349 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:23:59.365 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:23:59.361+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:23:59.368 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:23:59.369 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:23:59.389 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:23:59.389 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:23:59.400 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:23:59.400 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:23:59.405 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:23:59.406 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:23:59.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:23:59.427 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:23:59.427 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:23:59.449 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:23:59.449 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:23:59.466 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:23:59.460+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:23:59.470 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:23:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:23:59.486 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:23:59.486 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:23:59.506 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:23:59.506 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:23:59.527 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:23:59.528 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:23:59.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:23:59.525+0000 7fcf29025640 0 -- 172.21.15.59:0/705324600 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7fcf242256a0 msgr2=0x7fcf24227a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:23:59.536 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:23:59.536 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:23:59.536 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:23:59.536 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:23:59.536 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:23:59.550 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:23:59.550 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:23:59.551 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:23:59.567 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:59.564+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:23:59.668 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:23:59.664+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:23:59.709 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:23:59.709 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:23:59.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:23:59.709 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [] 2024-04-26T02:23:59.710 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:23:59.723 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:23:59.769 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:23:59.764+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:23:59.845 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:23:59.845 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:23:59.845 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:23:59.845 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:23:59.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:23:59.903 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:23:59.900+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:23:59.971 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:23:59.968+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:23:59.977 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-04-26T02:23:59.978 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:23:59.978 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:23:59.978 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:23:59.978 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:23:59.978 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:23:59.987 INFO:teuthology.orchestra.run.smithi059.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-26T02:23:59.998 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:00.072 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:00.068+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:00.163 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:00.163 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:00.163 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:00.163 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [] 2024-04-26T02:24:00.163 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:00.172 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:00.168+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:00.177 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:00.274 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:00.271+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:00.315 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:00.315 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:00.315 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:00.315 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:00.329 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:00.374 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:00.372+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:00.453 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:00.454 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:00.454 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:00.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:00.475 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:00.475+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:00.576 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:00.572+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:00.640 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:00.640 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:00.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:00.641 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [] 2024-04-26T02:24:00.641 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:00.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:00.678 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:00.677+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:00.772 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:00.772 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:00.773 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:00.773 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:00.778 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:00.776+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:00.788 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:00.880 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:00.877+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:00.952 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:00.952 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:00.952 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:00.966 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:00.981 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:00.979+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:01.019 DEBUG:teuthology.orchestra.run.smithi175:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight read -> 100 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight delete -> 50 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight snap_create -> 50 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight snap_remove -> 50 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight rollback -> 50 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight setattr -> 25 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight rmattr -> 25 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight copy_from -> 50 2024-04-26T02:24:01.042 INFO:tasks.rados.rados.0.smithi175.stdout:adding op weight append -> 100 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout:ceph version 19.0.0-2457-gddeaa917 (ddeaa91797339a19172c3036ff48cca58c12f448) squid (dev) 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout:Configuration: 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout: Number of operations: 400 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout: Number of objects: 50 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout: Max in flight operations: 16 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout: Object size (in bytes): 4000000 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout: Write stride min: 400000 2024-04-26T02:24:01.043 INFO:tasks.rados.rados.0.smithi175.stdout: Write stride max: 800000 2024-04-26T02:24:01.082 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:01.080+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.174117846, 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.073984011000000002, 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.097 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918606+0000", 2024-04-26T02:24:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.396e-06 2024-04-26T02:24:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918620+0000", 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918641+0000", 2024-04-26T02:24:01.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0389000000000001e-05 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918657+0000", 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6671999999999999e-05 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918805+0000", 2024-04-26T02:24:01.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014724900000000001 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918819+0000", 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4453e-05 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.988816+0000", 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069997045999999993 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989070+0000", 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025383399999999998 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989371+0000", 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030080500000000002 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.990597+0000", 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012262740000000001 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992421+0000", 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001824132 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992517+0000", 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5880999999999999e-05 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992587+0000", 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0359999999999997e-05 2024-04-26T02:24:01.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.937514716999999, 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017497523000000001, 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 87 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3300000000000001e-07 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155289+0000", 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1913e-05 2024-04-26T02:24:01.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155300+0000", 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1202e-05 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155308+0000", 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000001e-06 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160230+0000", 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049217719999999996 2024-04-26T02:24:01.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160358+0000", 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012813700000000001 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160555+0000", 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197207 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163938+0000", 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003382945 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172543+0000", 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086049179999999996 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172636+0000", 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2918999999999996e-05 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172704+0000", 2024-04-26T02:24:01.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8007000000000001e-05 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.937400439999999, 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017505889, 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.113 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 88 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155322+0000", 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155328+0000", 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2700000000000001e-06 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155358+0000", 2024-04-26T02:24:01.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0624999999999999e-05 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155373+0000", 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4229999999999999e-05 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.162973+0000", 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076001050000000002 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163128+0000", 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015489200000000001 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163377+0000", 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024957100000000003 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.165420+0000", 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020422349999999999 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172717+0000", 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072976839999999996 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172781+0000", 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3910000000000003e-05 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172827+0000", 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5587000000000002e-05 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326421+0000", 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.766299930000001, 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013297415, 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.119 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 111 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326421+0000", 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326421+0000", 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326422+0000", 2024-04-26T02:24:01.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7299999999999995e-07 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326428+0000", 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.716e-06 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326437+0000", 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1500000000000005e-06 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326444+0000", 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8959999999999997e-06 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.335131+0000", 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086875279999999999 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.335344+0000", 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021275299999999999 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.335655+0000", 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000311398 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339543+0000", 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0038873430000000001 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339566+0000", 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3292e-05 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339646+0000", 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9690000000000004e-05 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339719+0000", 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2976000000000001e-05 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326455+0000", 2024-04-26T02:24:01.126 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.766266354999999, 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01554615, 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 112 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326455+0000", 2024-04-26T02:24:01.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326455+0000", 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326456+0000", 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3e-07 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326634+0000", 2024-04-26T02:24:01.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000178197 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326648+0000", 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4346e-05 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326657+0000", 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9670000000000007e-06 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.337090+0000", 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010433237 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.337224+0000", 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013356699999999999 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.337427+0000", 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020312999999999999 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339861+0000", 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024334489999999999 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.341861+0000", 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002000464 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.341938+0000", 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7496000000000005e-05 2024-04-26T02:24:01.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342001+0000", 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2566999999999999e-05 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326673+0000", 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.76604822, 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017241099999999999, 2024-04-26T02:24:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 113 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326673+0000", 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326673+0000", 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326674+0000", 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0470000000000001e-06 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326680+0000", 2024-04-26T02:24:01.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8730000000000004e-06 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326689+0000", 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2629999999999992e-06 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326696+0000", 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1359999999999999e-06 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.338420+0000", 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011723444 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.338615+0000", 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019570000000000001 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.338875+0000", 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025975400000000001 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.343742+0000", 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048665419999999997 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.343766+0000", 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3927999999999999e-05 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.343851+0000", 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5372999999999997e-05 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.343914+0000", 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3040000000000006e-05 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.766014345, 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018318649999999999, 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.138 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 114 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:01.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326708+0000", 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9700000000000005e-07 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326713+0000", 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326722+0000", 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9199999999999993e-06 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326729+0000", 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1489999999999997e-06 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339956+0000", 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013227153 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340087+0000", 2024-04-26T02:24:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130946 2024-04-26T02:24:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340294+0000", 2024-04-26T02:24:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206434 2024-04-26T02:24:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344052+0000", 2024-04-26T02:24:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037581490000000001 2024-04-26T02:24:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344900+0000", 2024-04-26T02:24:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084779500000000004 2024-04-26T02:24:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344967+0000", 2024-04-26T02:24:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607000000000005e-05 2024-04-26T02:24:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345026+0000", 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8146999999999997e-05 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.148 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.765981462999999, 2024-04-26T02:24:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019222108000000002, 2024-04-26T02:24:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.149 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 115 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0399999999999995e-07 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326874+0000", 2024-04-26T02:24:01.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013342599999999999 2024-04-26T02:24:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326885+0000", 2024-04-26T02:24:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1323e-05 2024-04-26T02:24:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326893+0000", 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7659999999999998e-06 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342112+0000", 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015218537000000001 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342342+0000", 2024-04-26T02:24:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023057199999999999 2024-04-26T02:24:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342691+0000", 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034918900000000002 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345831+0000", 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031394740000000002 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345848+0000", 2024-04-26T02:24:01.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7686e-05 2024-04-26T02:24:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345912+0000", 2024-04-26T02:24:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3709999999999998e-05 2024-04-26T02:24:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345962+0000", 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9721e-05 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.157 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.765810792, 2024-04-26T02:24:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019714167000000001, 2024-04-26T02:24:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.158 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 116 2024-04-26T02:24:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.159 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326911+0000", 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326924+0000", 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2743e-05 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326934+0000", 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5459999999999997e-06 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326941+0000", 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1470000000000004e-06 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344124+0000", 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017183085000000001 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344238+0000", 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114591 2024-04-26T02:24:01.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344425+0000", 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018710800000000001 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345974+0000", 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001548979 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346498+0000", 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052335399999999996 2024-04-26T02:24:01.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346570+0000", 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1983000000000005e-05 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346625+0000", 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4843999999999999e-05 2024-04-26T02:24:01.164 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.165 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.7657688, 2024-04-26T02:24:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020133699000000001, 2024-04-26T02:24:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.166 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 117 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326953+0000", 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326959+0000", 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.823e-06 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326968+0000", 2024-04-26T02:24:01.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9530000000000005e-06 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326979+0000", 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1289e-05 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345091+0000", 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018111505999999999 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345217+0000", 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012587399999999999 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345409+0000", 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019226700000000001 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346352+0000", 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00094280000000000004 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346964+0000", 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061192899999999999 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347036+0000", 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2120999999999996e-05 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347086+0000", 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0377000000000002e-05 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.173 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491335+0000", 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.601386643, 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015258927, 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.174 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 137 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491335+0000", 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491335+0000", 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491336+0000", 2024-04-26T02:24:01.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2699999999999999e-06 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491546+0000", 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020969599999999999 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.177 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491567+0000", 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1429000000000001e-05 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491582+0000", 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5026e-05 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.502329+0000", 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010747458 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.502457+0000", 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012746400000000001 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.502653+0000", 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019568999999999999 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506301+0000", 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003648816 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506343+0000", 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1566999999999997e-05 2024-04-26T02:24:01.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506486+0000", 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143413 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506594+0000", 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107098 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491611+0000", 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.601110139999999, 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015325467000000001, 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 138 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.182 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491611+0000", 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491611+0000", 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491613+0000", 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.587e-06 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491623+0000", 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0766e-05 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491641+0000", 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7669e-05 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491656+0000", 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4649e-05 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.503973+0000", 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01231754 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504118+0000", 2024-04-26T02:24:01.185 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144256 2024-04-26T02:24:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504328+0000", 2024-04-26T02:24:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000210134 2024-04-26T02:24:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506618+0000", 2024-04-26T02:24:01.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022906490000000001 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506744+0000", 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012592699999999999 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506836+0000", 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1915000000000003e-05 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.506937+0000", 2024-04-26T02:24:01.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100375 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.601044113, 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018319485, 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.189 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 139 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:01.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491678+0000", 2024-04-26T02:24:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.333e-06 2024-04-26T02:24:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491688+0000", 2024-04-26T02:24:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9299999999999998e-06 2024-04-26T02:24:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491707+0000", 2024-04-26T02:24:01.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8281999999999999e-05 2024-04-26T02:24:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491720+0000", 2024-04-26T02:24:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3502e-05 2024-04-26T02:24:01.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504966+0000", 2024-04-26T02:24:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013245808 2024-04-26T02:24:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505190+0000", 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000223876 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505520+0000", 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032999 2024-04-26T02:24:01.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508527+0000", 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030072739999999999 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509751+0000", 2024-04-26T02:24:01.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012241719999999999 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509880+0000", 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128687 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509997+0000", 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116631 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.200 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.600980936999999, 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018559454, 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.201 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 140 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491742+0000", 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.404e-06 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491946+0000", 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204086 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491967+0000", 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1049000000000001e-05 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491983+0000", 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6356000000000001e-05 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507052+0000", 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015069173 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507208+0000", 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000155783 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507411+0000", 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020306 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510024+0000", 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026129 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510123+0000", 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8667999999999998e-05 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510230+0000", 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107565 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510300+0000", 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9410000000000001e-05 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.207 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.600709912999999, 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018767703, 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.208 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 141 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492013+0000", 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492039+0000", 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5952000000000002e-05 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492058+0000", 2024-04-26T02:24:01.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9215000000000002e-05 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492082+0000", 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4379000000000002e-05 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508623+0000", 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016540947 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508846+0000", 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022293599999999999 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509201+0000", 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035443900000000001 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510580+0000", 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013797379999999999 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510627+0000", 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6254000000000001e-05 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510715+0000", 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8215999999999997e-05 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510779+0000", 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4136999999999999e-05 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.213 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802658+0000", 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.290063102, 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016929545000000001, 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.214 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 185 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802658+0000", 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802658+0000", 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802660+0000", 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1459999999999999e-06 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802796+0000", 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013555699999999999 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802815+0000", 2024-04-26T02:24:01.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9519000000000001e-05 2024-04-26T02:24:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802835+0000", 2024-04-26T02:24:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9349000000000001e-05 2024-04-26T02:24:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.813513+0000", 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010678162999999999 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.813739+0000", 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022609799999999999 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.814121+0000", 2024-04-26T02:24:01.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00038158400000000002 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818054+0000", 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039338990000000002 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819445+0000", 2024-04-26T02:24:01.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013908740000000001 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819522+0000", 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6729000000000003e-05 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819588+0000", 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5627e-05 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.220 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.289857982000001, 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018162602999999999, 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.221 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 186 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802865+0000", 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.666e-06 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802876+0000", 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1246e-05 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802898+0000", 2024-04-26T02:24:01.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1645999999999999e-05 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802923+0000", 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5389e-05 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.815977+0000", 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013053301 2024-04-26T02:24:01.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816115+0000", 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138553 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816319+0000", 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204236 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820746+0000", 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044270739999999996 2024-04-26T02:24:01.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820868+0000", 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122127 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820949+0000", 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0395999999999994e-05 2024-04-26T02:24:01.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821026+0000", 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6969000000000001e-05 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:01.227 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.289772553000001, 2024-04-26T02:24:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018225614000000001, 2024-04-26T02:24:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.228 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 187 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802950+0000", 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802963+0000", 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3206e-05 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802982+0000", 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8519e-05 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803002+0000", 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0162000000000001e-05 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816937+0000", 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013934867 2024-04-26T02:24:01.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817068+0000", 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130734 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817285+0000", 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000217209 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820849+0000", 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035643160000000001 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821038+0000", 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000188767 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821122+0000", 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4243e-05 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821174+0000", 2024-04-26T02:24:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2181000000000001e-05 2024-04-26T02:24:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.234 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.289676331000001, 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018460061999999999, 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 188 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803046+0000", 2024-04-26T02:24:01.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4500000000000001e-06 2024-04-26T02:24:01.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.237 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.237 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803180+0000", 2024-04-26T02:24:01.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013367300000000001 2024-04-26T02:24:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803201+0000", 2024-04-26T02:24:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1399e-05 2024-04-26T02:24:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803217+0000", 2024-04-26T02:24:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5556000000000001e-05 2024-04-26T02:24:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818151+0000", 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014934374 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818319+0000", 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016765500000000001 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818541+0000", 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022229899999999999 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821196+0000", 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002654965 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821379+0000", 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018284400000000001 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821453+0000", 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3546000000000004e-05 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821505+0000", 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2301e-05 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.242 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.289476445, 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018840794000000001, 2024-04-26T02:24:01.243 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:01.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803246+0000", 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803257+0000", 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0825999999999999e-05 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803275+0000", 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8099999999999999e-05 2024-04-26T02:24:01.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803288+0000", 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2595999999999999e-05 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819675+0000", 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016387184999999999 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:01.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819800+0000", 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012490999999999999 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820077+0000", 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000277533 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821271+0000", 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193401 2024-04-26T02:24:01.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821965+0000", 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069420199999999999 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822036+0000", 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1119999999999997e-05 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:01.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822086+0000", 2024-04-26T02:24:01.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9400999999999997e-05 2024-04-26T02:24:01.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.250 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.250 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:01.250 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:01.250 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:01.251 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:01.252 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:01.249+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:01.352 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:01.348+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:01.420 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:01.420 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:01.420 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:01.434 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:01.454 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:01.452+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:01.531 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:01.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:01.531 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-04-26T02:24:01.531 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T02:24:01.531 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T02:24:01.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-04-26T02:24:01.554 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:01.554 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:01.554 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:01.555 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:01.555 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:01.555 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:01.552+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:01.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:01.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:01.655 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:01.653+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:01.663 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:01.664 INFO:teuthology.orchestra.run.smithi136.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T02:24:01.664 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:01.729 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:01.730 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:01.731 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:01.731 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:01.731 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:01.731 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [] 2024-04-26T02:24:01.731 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:01.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:01.750 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:01.750 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:01.759 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:01.756+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:01.770 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:01.770 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:01.792 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:01.792 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:01.809 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:01.810 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:01.829 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:01.830 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:01.850 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:01.851 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:01.861 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:01.856+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:01.863 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:01.864 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:01.864 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:01.864 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:01.873 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:01.874 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:01.878 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:01.892 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:01.892 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:01.915 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:01.935 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:01.935 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:01.955 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:01.955 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:01.963 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:01.961+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:01.972 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:01.972 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:01.994 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:01.994 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:02.000 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:02.000 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:02.000 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:02.001 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:02.001 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:02.002 INFO:tasks.rados.rados.0.smithi175.stdout:1: write initial oid 1 2024-04-26T02:24:02.002 INFO:tasks.rados.rados.0.smithi175.stdout:1: seq_num 0 ranges {0=32768} 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:1: writing smithi17529564-1 from 0 to 32768 tid 1 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:2: write initial oid 2 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:2: seq_num 1 ranges {0=32768} 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:2: writing smithi17529564-2 from 0 to 32768 tid 1 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:3: write initial oid 3 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:3: seq_num 2 ranges {0=49152} 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:3: writing smithi17529564-3 from 0 to 49152 tid 1 2024-04-26T02:24:02.004 INFO:tasks.rados.rados.0.smithi175.stdout:4: write initial oid 4 2024-04-26T02:24:02.005 INFO:tasks.rados.rados.0.smithi175.stdout:4: seq_num 3 ranges {0=65536} 2024-04-26T02:24:02.005 INFO:tasks.rados.rados.0.smithi175.stdout:4: writing smithi17529564-4 from 0 to 65536 tid 1 2024-04-26T02:24:02.005 INFO:tasks.rados.rados.0.smithi175.stdout:5: write initial oid 5 2024-04-26T02:24:02.006 INFO:tasks.rados.rados.0.smithi175.stdout:5: seq_num 4 ranges {0=81920} 2024-04-26T02:24:02.006 INFO:tasks.rados.rados.0.smithi175.stdout:5: writing smithi17529564-5 from 0 to 81920 tid 1 2024-04-26T02:24:02.006 INFO:tasks.rados.rados.0.smithi175.stdout:6: write initial oid 6 2024-04-26T02:24:02.006 INFO:tasks.rados.rados.0.smithi175.stdout:6: seq_num 5 ranges {0=98304} 2024-04-26T02:24:02.006 INFO:tasks.rados.rados.0.smithi175.stdout:6: writing smithi17529564-6 from 0 to 98304 tid 1 2024-04-26T02:24:02.008 INFO:tasks.rados.rados.0.smithi175.stdout:7: write initial oid 7 2024-04-26T02:24:02.008 INFO:tasks.rados.rados.0.smithi175.stdout:7: seq_num 6 ranges {0=114688} 2024-04-26T02:24:02.009 INFO:tasks.rados.rados.0.smithi175.stdout:7: writing smithi17529564-7 from 0 to 114688 tid 1 2024-04-26T02:24:02.010 INFO:tasks.rados.rados.0.smithi175.stdout:8: write initial oid 8 2024-04-26T02:24:02.010 INFO:tasks.rados.rados.0.smithi175.stdout:8: seq_num 7 ranges {0=131072} 2024-04-26T02:24:02.011 INFO:tasks.rados.rados.0.smithi175.stdout:8: writing smithi17529564-8 from 0 to 131072 tid 1 2024-04-26T02:24:02.011 INFO:tasks.rados.rados.0.smithi175.stdout:9: write initial oid 9 2024-04-26T02:24:02.011 INFO:tasks.rados.rados.0.smithi175.stdout:9: seq_num 8 ranges {0=147456} 2024-04-26T02:24:02.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:24:02.014 INFO:tasks.rados.rados.0.smithi175.stdout:9: writing smithi17529564-9 from 0 to 147456 tid 1 2024-04-26T02:24:02.014 INFO:tasks.rados.rados.0.smithi175.stdout:10: write initial oid 10 2024-04-26T02:24:02.014 INFO:tasks.rados.rados.0.smithi175.stdout:10: seq_num 9 ranges {0=163840} 2024-04-26T02:24:02.016 INFO:tasks.rados.rados.0.smithi175.stdout:10: writing smithi17529564-10 from 0 to 163840 tid 1 2024-04-26T02:24:02.016 INFO:tasks.rados.rados.0.smithi175.stdout:11: write initial oid 11 2024-04-26T02:24:02.016 INFO:tasks.rados.rados.0.smithi175.stdout:11: seq_num 10 ranges {0=180224} 2024-04-26T02:24:02.018 INFO:tasks.rados.rados.0.smithi175.stdout:11: writing smithi17529564-11 from 0 to 180224 tid 1 2024-04-26T02:24:02.018 INFO:tasks.rados.rados.0.smithi175.stdout:12: write initial oid 12 2024-04-26T02:24:02.019 INFO:tasks.rados.rados.0.smithi175.stdout:12: seq_num 11 ranges {0=196608} 2024-04-26T02:24:02.020 INFO:tasks.rados.rados.0.smithi175.stdout:12: writing smithi17529564-12 from 0 to 196608 tid 1 2024-04-26T02:24:02.020 INFO:tasks.rados.rados.0.smithi175.stdout:13: write initial oid 13 2024-04-26T02:24:02.021 INFO:tasks.rados.rados.0.smithi175.stdout:13: seq_num 12 ranges {0=212992} 2024-04-26T02:24:02.022 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:02.023 INFO:tasks.rados.rados.0.smithi175.stdout:13: writing smithi17529564-13 from 0 to 212992 tid 1 2024-04-26T02:24:02.024 INFO:tasks.rados.rados.0.smithi175.stdout:14: write initial oid 14 2024-04-26T02:24:02.024 INFO:tasks.rados.rados.0.smithi175.stdout:14: seq_num 13 ranges {0=229376} 2024-04-26T02:24:02.030 INFO:tasks.rados.rados.0.smithi175.stdout:14: writing smithi17529564-14 from 0 to 229376 tid 1 2024-04-26T02:24:02.030 INFO:tasks.rados.rados.0.smithi175.stdout:15: write initial oid 15 2024-04-26T02:24:02.030 INFO:tasks.rados.rados.0.smithi175.stdout:15: seq_num 14 ranges {0=245760} 2024-04-26T02:24:02.030 INFO:tasks.rados.rados.0.smithi175.stdout:15: writing smithi17529564-15 from 0 to 245760 tid 1 2024-04-26T02:24:02.030 INFO:tasks.rados.rados.0.smithi175.stdout:3: finishing write tid 1 to smithi17529564-3 2024-04-26T02:24:02.030 INFO:tasks.rados.rados.0.smithi175.stdout:1: finishing write tid 1 to smithi17529564-1 2024-04-26T02:24:02.031 INFO:tasks.rados.rados.0.smithi175.stdout:1: finishing write tid 2 to smithi17529564-1 2024-04-26T02:24:02.031 INFO:tasks.rados.rados.0.smithi175.stdout:2: finishing write tid 1 to smithi17529564-2 2024-04-26T02:24:02.031 INFO:tasks.rados.rados.0.smithi175.stdout:3: finishing write tid 2 to smithi17529564-3 2024-04-26T02:24:02.031 INFO:tasks.rados.rados.0.smithi175.stdout:4: finishing write tid 1 to smithi17529564-4 2024-04-26T02:24:02.031 INFO:tasks.rados.rados.0.smithi175.stdout:1: finishing write tid 3 to smithi17529564-1 2024-04-26T02:24:02.031 INFO:tasks.rados.rados.0.smithi175.stdout:1: oid 1 updating version 0 to 1 2024-04-26T02:24:02.031 INFO:tasks.rados.rados.0.smithi175.stdout:1: oid 1 updating version 1 to 2 2024-04-26T02:24:02.032 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-04-26T02:24:02.032 INFO:tasks.rados.rados.0.smithi175.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2024-04-26T02:24:02.032 INFO:tasks.rados.rados.0.smithi175.stdout:3: finishing write tid 3 to smithi17529564-3 2024-04-26T02:24:02.032 INFO:tasks.rados.rados.0.smithi175.stdout:3: oid 3 updating version 0 to 2 2024-04-26T02:24:02.032 INFO:tasks.rados.rados.0.smithi175.stdout:3: oid 3 version 2 is already newer than 1 2024-04-26T02:24:02.032 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-04-26T02:24:02.033 INFO:tasks.rados.rados.0.smithi175.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2024-04-26T02:24:02.033 INFO:tasks.rados.rados.0.smithi175.stdout:2: finishing write tid 2 to smithi17529564-2 2024-04-26T02:24:02.033 INFO:tasks.rados.rados.0.smithi175.stdout:4: finishing write tid 2 to smithi17529564-4 2024-04-26T02:24:02.033 INFO:tasks.rados.rados.0.smithi175.stdout:1: done (14 left) 2024-04-26T02:24:02.033 INFO:tasks.rados.rados.0.smithi175.stdout:3: done (13 left) 2024-04-26T02:24:02.033 INFO:tasks.rados.rados.0.smithi175.stdout:16: write initial oid 16 2024-04-26T02:24:02.033 INFO:tasks.rados.rados.0.smithi175.stdout:16: seq_num 15 ranges {0=262144} 2024-04-26T02:24:02.034 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:02.028+0000 7fe4377fe640 0 -- 172.21.15.59:0/1293365677 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7fe4382276f0 msgr2=0x7fe438229ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:02.036 INFO:tasks.rados.rados.0.smithi175.stdout:16: writing smithi17529564-16 from 0 to 262144 tid 1 2024-04-26T02:24:02.036 INFO:tasks.rados.rados.0.smithi175.stdout:17: write initial oid 17 2024-04-26T02:24:02.036 INFO:tasks.rados.rados.0.smithi175.stdout:4: finishing write tid 3 to smithi17529564-4 2024-04-26T02:24:02.036 INFO:tasks.rados.rados.0.smithi175.stdout:4: oid 4 updating version 0 to 1 2024-04-26T02:24:02.036 INFO:tasks.rados.rados.0.smithi175.stdout:4: oid 4 updating version 1 to 2 2024-04-26T02:24:02.036 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-04-26T02:24:02.036 INFO:tasks.rados.rados.0.smithi175.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2024-04-26T02:24:02.037 INFO:tasks.rados.rados.0.smithi175.stdout:5: finishing write tid 1 to smithi17529564-5 2024-04-26T02:24:02.037 INFO:tasks.rados.rados.0.smithi175.stdout:17: seq_num 16 ranges {0=278528} 2024-04-26T02:24:02.037 INFO:tasks.rados.rados.0.smithi175.stdout:17: writing smithi17529564-17 from 0 to 278528 tid 1 2024-04-26T02:24:02.037 INFO:tasks.rados.rados.0.smithi175.stdout:4: done (14 left) 2024-04-26T02:24:02.037 INFO:tasks.rados.rados.0.smithi175.stdout:18: write initial oid 18 2024-04-26T02:24:02.037 INFO:tasks.rados.rados.0.smithi175.stdout:18: seq_num 17 ranges {0=294912} 2024-04-26T02:24:02.039 INFO:tasks.rados.rados.0.smithi175.stdout:18: writing smithi17529564-18 from 0 to 294912 tid 1 2024-04-26T02:24:02.039 INFO:tasks.rados.rados.0.smithi175.stdout:19: write initial oid 19 2024-04-26T02:24:02.039 INFO:tasks.rados.rados.0.smithi175.stdout:19: seq_num 18 ranges {0=311296} 2024-04-26T02:24:02.043 INFO:tasks.rados.rados.0.smithi175.stdout:19: writing smithi17529564-19 from 0 to 311296 tid 1 2024-04-26T02:24:02.043 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.044 INFO:tasks.rados.rados.0.smithi175.stdout:12: finishing write tid 1 to smithi17529564-12 2024-04-26T02:24:02.044 INFO:tasks.rados.rados.0.smithi175.stdout:2: finishing write tid 3 to smithi17529564-2 2024-04-26T02:24:02.044 INFO:tasks.rados.rados.0.smithi175.stdout:2: oid 2 updating version 0 to 1 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:2: oid 2 updating version 1 to 2 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:5: finishing write tid 2 to smithi17529564-5 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:14: finishing write tid 1 to smithi17529564-14 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:14: finishing write tid 2 to smithi17529564-14 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:14: finishing write tid 3 to smithi17529564-14 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:14: oid 14 updating version 0 to 1 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:14: oid 14 updating version 1 to 2 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 14 v 2 (ObjNum 13 snap 0 seq_num 13) dirty exists 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:7: finishing write tid 1 to smithi17529564-7 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:7: finishing write tid 2 to smithi17529564-7 2024-04-26T02:24:02.045 INFO:tasks.rados.rados.0.smithi175.stdout:6: finishing write tid 1 to smithi17529564-6 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:6: finishing write tid 2 to smithi17529564-6 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:8: finishing write tid 1 to smithi17529564-8 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:8: finishing write tid 2 to smithi17529564-8 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:10: finishing write tid 1 to smithi17529564-10 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:10: finishing write tid 2 to smithi17529564-10 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:15: finishing write tid 1 to smithi17529564-15 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:15: finishing write tid 2 to smithi17529564-15 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:12: finishing write tid 2 to smithi17529564-12 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:2: done (15 left) 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:14: done (14 left) 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:20: write initial oid 20 2024-04-26T02:24:02.046 INFO:tasks.rados.rados.0.smithi175.stdout:20: seq_num 19 ranges {0=327680} 2024-04-26T02:24:02.047 INFO:tasks.rados.rados.0.smithi175.stdout:20: writing smithi17529564-20 from 0 to 327680 tid 1 2024-04-26T02:24:02.047 INFO:tasks.rados.rados.0.smithi175.stdout:21: write initial oid 21 2024-04-26T02:24:02.047 INFO:tasks.rados.rados.0.smithi175.stdout:21: seq_num 20 ranges {0=344064} 2024-04-26T02:24:02.052 INFO:tasks.rados.rados.0.smithi175.stdout:21: writing smithi17529564-21 from 0 to 344064 tid 1 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout:15: finishing write tid 3 to smithi17529564-15 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout:15: oid 15 updating version 0 to 2 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout:15: oid 15 version 2 is already newer than 1 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 15 v 2 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout:17: finishing write tid 1 to smithi17529564-17 2024-04-26T02:24:02.053 INFO:tasks.rados.rados.0.smithi175.stdout:5: finishing write tid 3 to smithi17529564-5 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:5: oid 5 updating version 0 to 1 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:5: oid 5 updating version 1 to 2 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:17: finishing write tid 2 to smithi17529564-17 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:11: finishing write tid 1 to smithi17529564-11 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:11: finishing write tid 2 to smithi17529564-11 2024-04-26T02:24:02.054 INFO:tasks.rados.rados.0.smithi175.stdout:13: finishing write tid 1 to smithi17529564-13 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:11: finishing write tid 3 to smithi17529564-11 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:11: oid 11 updating version 0 to 1 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:11: oid 11 updating version 1 to 2 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 11 v 2 (ObjNum 10 snap 0 seq_num 10) dirty exists 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:13: finishing write tid 2 to smithi17529564-13 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:13: finishing write tid 3 to smithi17529564-13 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:13: oid 13 updating version 0 to 4 2024-04-26T02:24:02.055 INFO:tasks.rados.rados.0.smithi175.stdout:13: oid 13 version 4 is already newer than 3 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 13 v 4 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:16: finishing write tid 1 to smithi17529564-16 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:16: finishing write tid 2 to smithi17529564-16 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:10: finishing write tid 3 to smithi17529564-10 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:10: oid 10 updating version 0 to 4 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:10: oid 10 version 4 is already newer than 3 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 10 v 4 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-04-26T02:24:02.056 INFO:tasks.rados.rados.0.smithi175.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2024-04-26T02:24:02.057 INFO:tasks.rados.rados.0.smithi175.stdout:5: done (15 left) 2024-04-26T02:24:02.057 INFO:tasks.rados.rados.0.smithi175.stdout:10: done (14 left) 2024-04-26T02:24:02.057 INFO:tasks.rados.rados.0.smithi175.stdout:11: done (13 left) 2024-04-26T02:24:02.057 INFO:tasks.rados.rados.0.smithi175.stdout:13: done (12 left) 2024-04-26T02:24:02.057 INFO:tasks.rados.rados.0.smithi175.stdout:15: done (11 left) 2024-04-26T02:24:02.057 INFO:tasks.rados.rados.0.smithi175.stdout:22: write initial oid 22 2024-04-26T02:24:02.057 INFO:tasks.rados.rados.0.smithi175.stdout:22: seq_num 21 ranges {0=360448} 2024-04-26T02:24:02.059 INFO:tasks.rados.rados.0.smithi175.stdout:22: writing smithi17529564-22 from 0 to 360448 tid 1 2024-04-26T02:24:02.059 INFO:tasks.rados.rados.0.smithi175.stdout:23: write initial oid 23 2024-04-26T02:24:02.059 INFO:tasks.rados.rados.0.smithi175.stdout:23: seq_num 22 ranges {0=376832} 2024-04-26T02:24:02.059 INFO:tasks.rados.rados.0.smithi175.stdout:23: writing smithi17529564-23 from 0 to 376832 tid 1 2024-04-26T02:24:02.059 INFO:tasks.rados.rados.0.smithi175.stdout:24: write initial oid 24 2024-04-26T02:24:02.062 INFO:tasks.rados.rados.0.smithi175.stdout:24: seq_num 23 ranges {0=393216} 2024-04-26T02:24:02.064 INFO:tasks.rados.rados.0.smithi175.stdout:24: writing smithi17529564-24 from 0 to 393216 tid 1 2024-04-26T02:24:02.064 INFO:tasks.rados.rados.0.smithi175.stdout:25: write initial oid 25 2024-04-26T02:24:02.064 INFO:tasks.rados.rados.0.smithi175.stdout:25: seq_num 24 ranges {0=409600} 2024-04-26T02:24:02.065 INFO:tasks.rados.rados.0.smithi175.stdout:25: writing smithi17529564-25 from 0 to 409600 tid 1 2024-04-26T02:24:02.065 INFO:tasks.rados.rados.0.smithi175.stdout:26: write initial oid 26 2024-04-26T02:24:02.065 INFO:tasks.rados.rados.0.smithi175.stdout:26: seq_num 25 ranges {0=425984} 2024-04-26T02:24:02.066 INFO:tasks.rados.rados.0.smithi175.stdout:26: writing smithi17529564-26 from 0 to 425984 tid 1 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout:17: finishing write tid 3 to smithi17529564-17 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout:17: oid 17 updating version 0 to 6 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout:17: oid 17 version 6 is already newer than 5 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 17 v 6 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout:17: done (15 left) 2024-04-26T02:24:02.067 INFO:tasks.rados.rados.0.smithi175.stdout:27: write initial oid 27 2024-04-26T02:24:02.068 INFO:tasks.rados.rados.0.smithi175.stdout:27: seq_num 26 ranges {0=442368} 2024-04-26T02:24:02.068 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:02.063+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:02.069 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:02.069 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:02.070 INFO:tasks.rados.rados.0.smithi175.stdout:27: writing smithi17529564-27 from 0 to 442368 tid 1 2024-04-26T02:24:02.070 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.070 INFO:tasks.rados.rados.0.smithi175.stdout:16: finishing write tid 3 to smithi17529564-16 2024-04-26T02:24:02.071 INFO:tasks.rados.rados.0.smithi175.stdout:16: oid 16 updating version 0 to 2 2024-04-26T02:24:02.071 INFO:tasks.rados.rados.0.smithi175.stdout:16: oid 16 version 2 is already newer than 1 2024-04-26T02:24:02.071 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 16 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2024-04-26T02:24:02.071 INFO:tasks.rados.rados.0.smithi175.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2024-04-26T02:24:02.071 INFO:tasks.rados.rados.0.smithi175.stdout:9: finishing write tid 1 to smithi17529564-9 2024-04-26T02:24:02.071 INFO:tasks.rados.rados.0.smithi175.stdout:9: finishing write tid 2 to smithi17529564-9 2024-04-26T02:24:02.071 INFO:tasks.rados.rados.0.smithi175.stdout:16: done (15 left) 2024-04-26T02:24:02.072 INFO:tasks.rados.rados.0.smithi175.stdout:28: write initial oid 28 2024-04-26T02:24:02.072 INFO:tasks.rados.rados.0.smithi175.stdout:28: seq_num 27 ranges {0=458752} 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:28: writing smithi17529564-28 from 0 to 458752 tid 1 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:12: finishing write tid 3 to smithi17529564-12 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:12: oid 12 updating version 0 to 1 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:12: oid 12 updating version 1 to 2 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 12 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:12: done (15 left) 2024-04-26T02:24:02.073 INFO:tasks.rados.rados.0.smithi175.stdout:29: write initial oid 29 2024-04-26T02:24:02.074 INFO:tasks.rados.rados.0.smithi175.stdout:29: seq_num 28 ranges {0=475136} 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:29: writing smithi17529564-29 from 0 to 475136 tid 1 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:6: finishing write tid 3 to smithi17529564-6 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:6: oid 6 updating version 0 to 1 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:6: oid 6 updating version 1 to 2 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:6: done (15 left) 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:30: write initial oid 30 2024-04-26T02:24:02.076 INFO:tasks.rados.rados.0.smithi175.stdout:30: seq_num 29 ranges {0=491520} 2024-04-26T02:24:02.080 INFO:tasks.rados.rados.0.smithi175.stdout:30: writing smithi17529564-30 from 0 to 491520 tid 1 2024-04-26T02:24:02.081 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.081 INFO:tasks.rados.rados.0.smithi175.stdout:9: finishing write tid 3 to smithi17529564-9 2024-04-26T02:24:02.081 INFO:tasks.rados.rados.0.smithi175.stdout:9: oid 9 updating version 0 to 3 2024-04-26T02:24:02.081 INFO:tasks.rados.rados.0.smithi175.stdout:9: oid 9 updating version 3 to 4 2024-04-26T02:24:02.081 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 9 v 4 (ObjNum 8 snap 0 seq_num 8) dirty exists 2024-04-26T02:24:02.082 INFO:tasks.rados.rados.0.smithi175.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2024-04-26T02:24:02.082 INFO:tasks.rados.rados.0.smithi175.stdout:18: finishing write tid 1 to smithi17529564-18 2024-04-26T02:24:02.082 INFO:tasks.rados.rados.0.smithi175.stdout:18: finishing write tid 2 to smithi17529564-18 2024-04-26T02:24:02.082 INFO:tasks.rados.rados.0.smithi175.stdout:18: finishing write tid 3 to smithi17529564-18 2024-04-26T02:24:02.082 INFO:tasks.rados.rados.0.smithi175.stdout:18: oid 18 updating version 0 to 6 2024-04-26T02:24:02.082 INFO:tasks.rados.rados.0.smithi175.stdout:18: oid 18 version 6 is already newer than 5 2024-04-26T02:24:02.083 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 18 v 6 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-04-26T02:24:02.083 INFO:tasks.rados.rados.0.smithi175.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2024-04-26T02:24:02.083 INFO:tasks.rados.rados.0.smithi175.stdout:8: finishing write tid 3 to smithi17529564-8 2024-04-26T02:24:02.083 INFO:tasks.rados.rados.0.smithi175.stdout:8: oid 8 updating version 0 to 3 2024-04-26T02:24:02.083 INFO:tasks.rados.rados.0.smithi175.stdout:8: oid 8 updating version 3 to 4 2024-04-26T02:24:02.083 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 8 v 4 (ObjNum 7 snap 0 seq_num 7) dirty exists 2024-04-26T02:24:02.083 INFO:tasks.rados.rados.0.smithi175.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2024-04-26T02:24:02.085 INFO:tasks.rados.rados.0.smithi175.stdout:7: finishing write tid 3 to smithi17529564-7 2024-04-26T02:24:02.085 INFO:tasks.rados.rados.0.smithi175.stdout:7: oid 7 updating version 0 to 1 2024-04-26T02:24:02.085 INFO:tasks.rados.rados.0.smithi175.stdout:7: oid 7 updating version 1 to 2 2024-04-26T02:24:02.086 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2024-04-26T02:24:02.086 INFO:tasks.rados.rados.0.smithi175.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2024-04-26T02:24:02.086 INFO:tasks.rados.rados.0.smithi175.stdout:20: finishing write tid 1 to smithi17529564-20 2024-04-26T02:24:02.086 INFO:tasks.rados.rados.0.smithi175.stdout:7: done (15 left) 2024-04-26T02:24:02.087 INFO:tasks.rados.rados.0.smithi175.stdout:8: done (14 left) 2024-04-26T02:24:02.087 INFO:tasks.rados.rados.0.smithi175.stdout:9: done (13 left) 2024-04-26T02:24:02.087 INFO:tasks.rados.rados.0.smithi175.stdout:18: done (12 left) 2024-04-26T02:24:02.087 INFO:tasks.rados.rados.0.smithi175.stdout:31: write initial oid 31 2024-04-26T02:24:02.087 INFO:tasks.rados.rados.0.smithi175.stdout:31: seq_num 30 ranges {0=507904} 2024-04-26T02:24:02.088 INFO:tasks.rados.rados.0.smithi175.stdout:31: writing smithi17529564-31 from 0 to 507904 tid 1 2024-04-26T02:24:02.089 INFO:tasks.rados.rados.0.smithi175.stdout:32: write initial oid 32 2024-04-26T02:24:02.089 INFO:tasks.rados.rados.0.smithi175.stdout:32: seq_num 31 ranges {0=524288} 2024-04-26T02:24:02.089 INFO:tasks.rados.rados.0.smithi175.stdout:32: writing smithi17529564-32 from 0 to 524288 tid 1 2024-04-26T02:24:02.089 INFO:tasks.rados.rados.0.smithi175.stdout:33: write initial oid 33 2024-04-26T02:24:02.089 INFO:tasks.rados.rados.0.smithi175.stdout:33: seq_num 32 ranges {0=540672} 2024-04-26T02:24:02.091 INFO:tasks.rados.rados.0.smithi175.stdout:33: writing smithi17529564-33 from 0 to 540672 tid 1 2024-04-26T02:24:02.091 INFO:tasks.rados.rados.0.smithi175.stdout:34: write initial oid 34 2024-04-26T02:24:02.092 INFO:tasks.rados.rados.0.smithi175.stdout:34: seq_num 33 ranges {0=557056} 2024-04-26T02:24:02.100 INFO:tasks.rados.rados.0.smithi175.stdout:34: writing smithi17529564-34 from 0 to 557056 tid 1 2024-04-26T02:24:02.100 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.100 INFO:tasks.rados.rados.0.smithi175.stdout:20: finishing write tid 2 to smithi17529564-20 2024-04-26T02:24:02.100 INFO:tasks.rados.rados.0.smithi175.stdout:24: finishing write tid 1 to smithi17529564-24 2024-04-26T02:24:02.101 INFO:tasks.rados.rados.0.smithi175.stdout:24: finishing write tid 2 to smithi17529564-24 2024-04-26T02:24:02.101 INFO:tasks.rados.rados.0.smithi175.stdout:22: finishing write tid 1 to smithi17529564-22 2024-04-26T02:24:02.101 INFO:tasks.rados.rados.0.smithi175.stdout:22: finishing write tid 2 to smithi17529564-22 2024-04-26T02:24:02.101 INFO:tasks.rados.rados.0.smithi175.stdout:19: finishing write tid 1 to smithi17529564-19 2024-04-26T02:24:02.102 INFO:tasks.rados.rados.0.smithi175.stdout:19: finishing write tid 2 to smithi17529564-19 2024-04-26T02:24:02.102 INFO:tasks.rados.rados.0.smithi175.stdout:23: finishing write tid 1 to smithi17529564-23 2024-04-26T02:24:02.102 INFO:tasks.rados.rados.0.smithi175.stdout:24: finishing write tid 3 to smithi17529564-24 2024-04-26T02:24:02.102 INFO:tasks.rados.rados.0.smithi175.stdout:24: oid 24 updating version 0 to 3 2024-04-26T02:24:02.102 INFO:tasks.rados.rados.0.smithi175.stdout:24: oid 24 updating version 3 to 4 2024-04-26T02:24:02.103 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 24 v 4 (ObjNum 23 snap 0 seq_num 23) dirty exists 2024-04-26T02:24:02.103 INFO:tasks.rados.rados.0.smithi175.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2024-04-26T02:24:02.103 INFO:tasks.rados.rados.0.smithi175.stdout:23: finishing write tid 2 to smithi17529564-23 2024-04-26T02:24:02.103 INFO:tasks.rados.rados.0.smithi175.stdout:25: finishing write tid 1 to smithi17529564-25 2024-04-26T02:24:02.103 INFO:tasks.rados.rados.0.smithi175.stdout:20: finishing write tid 3 to smithi17529564-20 2024-04-26T02:24:02.103 INFO:tasks.rados.rados.0.smithi175.stdout:20: oid 20 updating version 0 to 1 2024-04-26T02:24:02.103 INFO:tasks.rados.rados.0.smithi175.stdout:20: oid 20 updating version 1 to 2 2024-04-26T02:24:02.104 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 20 v 2 (ObjNum 19 snap 0 seq_num 19) dirty exists 2024-04-26T02:24:02.104 INFO:tasks.rados.rados.0.smithi175.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2024-04-26T02:24:02.104 INFO:tasks.rados.rados.0.smithi175.stdout:22: finishing write tid 3 to smithi17529564-22 2024-04-26T02:24:02.104 INFO:tasks.rados.rados.0.smithi175.stdout:22: oid 22 updating version 0 to 3 2024-04-26T02:24:02.104 INFO:tasks.rados.rados.0.smithi175.stdout:22: oid 22 updating version 3 to 4 2024-04-26T02:24:02.104 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 22 v 4 (ObjNum 21 snap 0 seq_num 21) dirty exists 2024-04-26T02:24:02.105 INFO:tasks.rados.rados.0.smithi175.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2024-04-26T02:24:02.105 INFO:tasks.rados.rados.0.smithi175.stdout:25: finishing write tid 2 to smithi17529564-25 2024-04-26T02:24:02.105 INFO:tasks.rados.rados.0.smithi175.stdout:26: finishing write tid 1 to smithi17529564-26 2024-04-26T02:24:02.105 INFO:tasks.rados.rados.0.smithi175.stdout:25: finishing write tid 3 to smithi17529564-25 2024-04-26T02:24:02.106 INFO:tasks.rados.rados.0.smithi175.stdout:25: oid 25 updating version 0 to 6 2024-04-26T02:24:02.106 INFO:tasks.rados.rados.0.smithi175.stdout:25: oid 25 version 6 is already newer than 5 2024-04-26T02:24:02.106 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 25 v 6 (ObjNum 24 snap 0 seq_num 24) dirty exists 2024-04-26T02:24:02.106 INFO:tasks.rados.rados.0.smithi175.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2024-04-26T02:24:02.107 INFO:tasks.rados.rados.0.smithi175.stdout:19: finishing write tid 3 to smithi17529564-19 2024-04-26T02:24:02.107 INFO:tasks.rados.rados.0.smithi175.stdout:19: oid 19 updating version 0 to 4 2024-04-26T02:24:02.107 INFO:tasks.rados.rados.0.smithi175.stdout:19: oid 19 version 4 is already newer than 3 2024-04-26T02:24:02.107 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 19 v 4 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-04-26T02:24:02.107 INFO:tasks.rados.rados.0.smithi175.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2024-04-26T02:24:02.107 INFO:tasks.rados.rados.0.smithi175.stdout:26: finishing write tid 2 to smithi17529564-26 2024-04-26T02:24:02.108 INFO:tasks.rados.rados.0.smithi175.stdout:23: finishing write tid 3 to smithi17529564-23 2024-04-26T02:24:02.108 INFO:tasks.rados.rados.0.smithi175.stdout:23: oid 23 updating version 0 to 6 2024-04-26T02:24:02.108 INFO:tasks.rados.rados.0.smithi175.stdout:23: oid 23 version 6 is already newer than 5 2024-04-26T02:24:02.108 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2024-04-26T02:24:02.108 INFO:tasks.rados.rados.0.smithi175.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2024-04-26T02:24:02.108 INFO:tasks.rados.rados.0.smithi175.stdout:27: finishing write tid 1 to smithi17529564-27 2024-04-26T02:24:02.108 INFO:tasks.rados.rados.0.smithi175.stdout:27: finishing write tid 2 to smithi17529564-27 2024-04-26T02:24:02.109 INFO:tasks.rados.rados.0.smithi175.stdout:26: finishing write tid 3 to smithi17529564-26 2024-04-26T02:24:02.109 INFO:tasks.rados.rados.0.smithi175.stdout:26: oid 26 updating version 0 to 4 2024-04-26T02:24:02.109 INFO:tasks.rados.rados.0.smithi175.stdout:26: oid 26 version 4 is already newer than 3 2024-04-26T02:24:02.109 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 26 v 4 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-04-26T02:24:02.109 INFO:tasks.rados.rados.0.smithi175.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2024-04-26T02:24:02.109 INFO:tasks.rados.rados.0.smithi175.stdout:27: finishing write tid 3 to smithi17529564-27 2024-04-26T02:24:02.110 INFO:tasks.rados.rados.0.smithi175.stdout:27: oid 27 updating version 0 to 3 2024-04-26T02:24:02.110 INFO:tasks.rados.rados.0.smithi175.stdout:27: oid 27 updating version 3 to 4 2024-04-26T02:24:02.110 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 27 v 4 (ObjNum 26 snap 0 seq_num 26) dirty exists 2024-04-26T02:24:02.110 INFO:tasks.rados.rados.0.smithi175.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2024-04-26T02:24:02.110 INFO:tasks.rados.rados.0.smithi175.stdout:29: finishing write tid 1 to smithi17529564-29 2024-04-26T02:24:02.111 INFO:tasks.rados.rados.0.smithi175.stdout:29: finishing write tid 2 to smithi17529564-29 2024-04-26T02:24:02.111 INFO:tasks.rados.rados.0.smithi175.stdout:29: finishing write tid 3 to smithi17529564-29 2024-04-26T02:24:02.111 INFO:tasks.rados.rados.0.smithi175.stdout:29: oid 29 updating version 0 to 6 2024-04-26T02:24:02.111 INFO:tasks.rados.rados.0.smithi175.stdout:29: oid 29 version 6 is already newer than 5 2024-04-26T02:24:02.111 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 29 v 6 (ObjNum 28 snap 0 seq_num 28) dirty exists 2024-04-26T02:24:02.112 INFO:tasks.rados.rados.0.smithi175.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2024-04-26T02:24:02.112 INFO:tasks.rados.rados.0.smithi175.stdout:30: finishing write tid 1 to smithi17529564-30 2024-04-26T02:24:02.113 INFO:tasks.rados.rados.0.smithi175.stdout:30: finishing write tid 2 to smithi17529564-30 2024-04-26T02:24:02.113 INFO:tasks.rados.rados.0.smithi175.stdout:31: finishing write tid 1 to smithi17529564-31 2024-04-26T02:24:02.113 INFO:tasks.rados.rados.0.smithi175.stdout:31: finishing write tid 2 to smithi17529564-31 2024-04-26T02:24:02.113 INFO:tasks.rados.rados.0.smithi175.stdout:19: done (15 left) 2024-04-26T02:24:02.113 INFO:tasks.rados.rados.0.smithi175.stdout:20: done (14 left) 2024-04-26T02:24:02.113 INFO:tasks.rados.rados.0.smithi175.stdout:22: done (13 left) 2024-04-26T02:24:02.113 INFO:tasks.rados.rados.0.smithi175.stdout:23: done (12 left) 2024-04-26T02:24:02.114 INFO:tasks.rados.rados.0.smithi175.stdout:24: done (11 left) 2024-04-26T02:24:02.114 INFO:tasks.rados.rados.0.smithi175.stdout:25: done (10 left) 2024-04-26T02:24:02.114 INFO:tasks.rados.rados.0.smithi175.stdout:26: done (9 left) 2024-04-26T02:24:02.114 INFO:tasks.rados.rados.0.smithi175.stdout:27: done (8 left) 2024-04-26T02:24:02.114 INFO:tasks.rados.rados.0.smithi175.stdout:29: done (7 left) 2024-04-26T02:24:02.115 INFO:tasks.rados.rados.0.smithi175.stdout:35: write initial oid 35 2024-04-26T02:24:02.115 INFO:tasks.rados.rados.0.smithi175.stdout:35: seq_num 34 ranges {0=573440} 2024-04-26T02:24:02.115 INFO:tasks.rados.rados.0.smithi175.stdout:35: writing smithi17529564-35 from 0 to 573440 tid 1 2024-04-26T02:24:02.115 INFO:tasks.rados.rados.0.smithi175.stdout:36: write initial oid 36 2024-04-26T02:24:02.115 INFO:tasks.rados.rados.0.smithi175.stdout:36: seq_num 35 ranges {0=589824} 2024-04-26T02:24:02.120 INFO:tasks.rados.rados.0.smithi175.stdout:36: writing smithi17529564-36 from 0 to 589824 tid 1 2024-04-26T02:24:02.120 INFO:tasks.rados.rados.0.smithi175.stdout:37: write initial oid 37 2024-04-26T02:24:02.120 INFO:tasks.rados.rados.0.smithi175.stdout:37: seq_num 36 ranges {0=606208} 2024-04-26T02:24:02.120 INFO:tasks.rados.rados.0.smithi175.stdout:37: writing smithi17529564-37 from 0 to 606208 tid 1 2024-04-26T02:24:02.120 INFO:tasks.rados.rados.0.smithi175.stdout:38: write initial oid 38 2024-04-26T02:24:02.120 INFO:tasks.rados.rados.0.smithi175.stdout:38: seq_num 37 ranges {0=622592} 2024-04-26T02:24:02.120 INFO:tasks.rados.rados.0.smithi175.stdout:38: writing smithi17529564-38 from 0 to 622592 tid 1 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:39: write initial oid 39 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:39: seq_num 38 ranges {0=638976} 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:39: writing smithi17529564-39 from 0 to 638976 tid 1 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:40: write initial oid 40 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:40: seq_num 39 ranges {0=671744} 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:40: writing smithi17529564-40 from 0 to 671744 tid 1 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:41: write initial oid 41 2024-04-26T02:24:02.121 INFO:tasks.rados.rados.0.smithi175.stdout:41: seq_num 40 ranges {0=688128} 2024-04-26T02:24:02.122 INFO:tasks.rados.rados.0.smithi175.stdout:41: writing smithi17529564-41 from 0 to 688128 tid 1 2024-04-26T02:24:02.122 INFO:tasks.rados.rados.0.smithi175.stdout:42: write initial oid 42 2024-04-26T02:24:02.123 INFO:tasks.rados.rados.0.smithi175.stdout:42: seq_num 41 ranges {0=704512} 2024-04-26T02:24:02.127 INFO:tasks.rados.rados.0.smithi175.stdout:42: writing smithi17529564-42 from 0 to 704512 tid 1 2024-04-26T02:24:02.128 INFO:tasks.rados.rados.0.smithi175.stdout:43: write initial oid 43 2024-04-26T02:24:02.128 INFO:tasks.rados.rados.0.smithi175.stdout:43: seq_num 42 ranges {0=720896} 2024-04-26T02:24:02.132 INFO:tasks.rados.rados.0.smithi175.stdout:43: writing smithi17529564-43 from 0 to 720896 tid 1 2024-04-26T02:24:02.132 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.132 INFO:tasks.rados.rados.0.smithi175.stdout:30: finishing write tid 3 to smithi17529564-30 2024-04-26T02:24:02.132 INFO:tasks.rados.rados.0.smithi175.stdout:30: oid 30 updating version 0 to 6 2024-04-26T02:24:02.132 INFO:tasks.rados.rados.0.smithi175.stdout:30: oid 30 version 6 is already newer than 5 2024-04-26T02:24:02.133 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2024-04-26T02:24:02.133 INFO:tasks.rados.rados.0.smithi175.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2024-04-26T02:24:02.133 INFO:tasks.rados.rados.0.smithi175.stdout:30: done (15 left) 2024-04-26T02:24:02.133 INFO:tasks.rados.rados.0.smithi175.stdout:44: write initial oid 44 2024-04-26T02:24:02.133 INFO:tasks.rados.rados.0.smithi175.stdout:44: seq_num 43 ranges {0=737280} 2024-04-26T02:24:02.137 INFO:tasks.rados.rados.0.smithi175.stdout:44: writing smithi17529564-44 from 0 to 737280 tid 1 2024-04-26T02:24:02.137 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.137 INFO:tasks.rados.rados.0.smithi175.stdout:33: finishing write tid 1 to smithi17529564-33 2024-04-26T02:24:02.137 INFO:tasks.rados.rados.0.smithi175.stdout:31: finishing write tid 3 to smithi17529564-31 2024-04-26T02:24:02.137 INFO:tasks.rados.rados.0.smithi175.stdout:31: oid 31 updating version 0 to 4 2024-04-26T02:24:02.137 INFO:tasks.rados.rados.0.smithi175.stdout:31: oid 31 version 4 is already newer than 3 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 31 v 4 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:33: finishing write tid 2 to smithi17529564-33 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:34: finishing write tid 1 to smithi17529564-34 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:33: finishing write tid 3 to smithi17529564-33 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:33: oid 33 updating version 0 to 4 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:33: oid 33 version 4 is already newer than 3 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 33 v 4 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:32: finishing write tid 1 to smithi17529564-32 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:31: done (15 left) 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:33: done (14 left) 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:45: write initial oid 45 2024-04-26T02:24:02.138 INFO:tasks.rados.rados.0.smithi175.stdout:45: seq_num 44 ranges {0=753664} 2024-04-26T02:24:02.150 INFO:tasks.rados.rados.0.smithi175.stdout:45: writing smithi17529564-45 from 0 to 753664 tid 1 2024-04-26T02:24:02.150 INFO:tasks.rados.rados.0.smithi175.stdout:46: write initial oid 46 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout:46: seq_num 45 ranges {0=770048} 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout:46: writing smithi17529564-46 from 0 to 770048 tid 1 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 16 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout:32: finishing write tid 2 to smithi17529564-32 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout:34: finishing write tid 2 to smithi17529564-34 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout:34: finishing write tid 3 to smithi17529564-34 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout:34: oid 34 updating version 0 to 8 2024-04-26T02:24:02.151 INFO:tasks.rados.rados.0.smithi175.stdout:34: oid 34 version 8 is already newer than 7 2024-04-26T02:24:02.152 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 34 v 8 (ObjNum 33 snap 0 seq_num 33) dirty exists 2024-04-26T02:24:02.152 INFO:tasks.rados.rados.0.smithi175.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2024-04-26T02:24:02.152 INFO:tasks.rados.rados.0.smithi175.stdout:32: finishing write tid 3 to smithi17529564-32 2024-04-26T02:24:02.152 INFO:tasks.rados.rados.0.smithi175.stdout:32: oid 32 updating version 0 to 7 2024-04-26T02:24:02.152 INFO:tasks.rados.rados.0.smithi175.stdout:32: oid 32 updating version 7 to 8 2024-04-26T02:24:02.152 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 32 v 8 (ObjNum 31 snap 0 seq_num 31) dirty exists 2024-04-26T02:24:02.152 INFO:tasks.rados.rados.0.smithi175.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2024-04-26T02:24:02.153 INFO:tasks.rados.rados.0.smithi175.stdout:35: finishing write tid 1 to smithi17529564-35 2024-04-26T02:24:02.153 INFO:tasks.rados.rados.0.smithi175.stdout:35: finishing write tid 2 to smithi17529564-35 2024-04-26T02:24:02.154 INFO:tasks.rados.rados.0.smithi175.stdout:35: finishing write tid 3 to smithi17529564-35 2024-04-26T02:24:02.154 INFO:tasks.rados.rados.0.smithi175.stdout:35: oid 35 updating version 0 to 6 2024-04-26T02:24:02.154 INFO:tasks.rados.rados.0.smithi175.stdout:35: oid 35 version 6 is already newer than 5 2024-04-26T02:24:02.154 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 35 v 6 (ObjNum 34 snap 0 seq_num 34) dirty exists 2024-04-26T02:24:02.154 INFO:tasks.rados.rados.0.smithi175.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2024-04-26T02:24:02.155 INFO:tasks.rados.rados.0.smithi175.stdout:36: finishing write tid 1 to smithi17529564-36 2024-04-26T02:24:02.155 INFO:tasks.rados.rados.0.smithi175.stdout:36: finishing write tid 2 to smithi17529564-36 2024-04-26T02:24:02.155 INFO:tasks.rados.rados.0.smithi175.stdout:37: finishing write tid 1 to smithi17529564-37 2024-04-26T02:24:02.155 INFO:tasks.rados.rados.0.smithi175.stdout:37: finishing write tid 2 to smithi17529564-37 2024-04-26T02:24:02.155 INFO:tasks.rados.rados.0.smithi175.stdout:36: finishing write tid 3 to smithi17529564-36 2024-04-26T02:24:02.155 INFO:tasks.rados.rados.0.smithi175.stdout:36: oid 36 updating version 0 to 4 2024-04-26T02:24:02.156 INFO:tasks.rados.rados.0.smithi175.stdout:36: oid 36 version 4 is already newer than 3 2024-04-26T02:24:02.156 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 36 v 4 (ObjNum 35 snap 0 seq_num 35) dirty exists 2024-04-26T02:24:02.156 INFO:tasks.rados.rados.0.smithi175.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2024-04-26T02:24:02.156 INFO:tasks.rados.rados.0.smithi175.stdout:38: finishing write tid 1 to smithi17529564-38 2024-04-26T02:24:02.156 INFO:tasks.rados.rados.0.smithi175.stdout:37: finishing write tid 3 to smithi17529564-37 2024-04-26T02:24:02.156 INFO:tasks.rados.rados.0.smithi175.stdout:37: oid 37 updating version 0 to 9 2024-04-26T02:24:02.156 INFO:tasks.rados.rados.0.smithi175.stdout:37: oid 37 updating version 9 to 10 2024-04-26T02:24:02.157 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 37 v 10 (ObjNum 36 snap 0 seq_num 36) dirty exists 2024-04-26T02:24:02.157 INFO:tasks.rados.rados.0.smithi175.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2024-04-26T02:24:02.157 INFO:tasks.rados.rados.0.smithi175.stdout:38: finishing write tid 2 to smithi17529564-38 2024-04-26T02:24:02.157 INFO:tasks.rados.rados.0.smithi175.stdout:39: finishing write tid 1 to smithi17529564-39 2024-04-26T02:24:02.157 INFO:tasks.rados.rados.0.smithi175.stdout:39: finishing write tid 2 to smithi17529564-39 2024-04-26T02:24:02.157 INFO:tasks.rados.rados.0.smithi175.stdout:38: finishing write tid 3 to smithi17529564-38 2024-04-26T02:24:02.158 INFO:tasks.rados.rados.0.smithi175.stdout:38: oid 38 updating version 0 to 5 2024-04-26T02:24:02.158 INFO:tasks.rados.rados.0.smithi175.stdout:38: oid 38 updating version 5 to 6 2024-04-26T02:24:02.158 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 38 v 6 (ObjNum 37 snap 0 seq_num 37) dirty exists 2024-04-26T02:24:02.158 INFO:tasks.rados.rados.0.smithi175.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2024-04-26T02:24:02.158 INFO:tasks.rados.rados.0.smithi175.stdout:39: finishing write tid 3 to smithi17529564-39 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:39: oid 39 updating version 0 to 6 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:39: oid 39 version 6 is already newer than 5 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 39 v 6 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:40: finishing write tid 1 to smithi17529564-40 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:32: done (15 left) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:34: done (14 left) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:35: done (13 left) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:36: done (12 left) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:37: done (11 left) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:38: done (10 left) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:39: done (9 left) 2024-04-26T02:24:02.160 INFO:tasks.rados.rados.0.smithi175.stdout:47: write initial oid 47 2024-04-26T02:24:02.161 INFO:tasks.rados.rados.0.smithi175.stdout:47: seq_num 46 ranges {0=786432} 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:47: writing smithi17529564-47 from 0 to 786432 tid 1 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:48: write initial oid 48 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:48: seq_num 47 ranges {0=425984,425984=376832} 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:48: writing smithi17529564-48 from 0 to 425984 tid 1 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:48: writing smithi17529564-48 from 425984 to 802816 tid 2 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:49: write initial oid 49 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:49: seq_num 48 ranges {0=442368,442368=376832} 2024-04-26T02:24:02.162 INFO:tasks.rados.rados.0.smithi175.stdout:49: writing smithi17529564-49 from 0 to 442368 tid 1 2024-04-26T02:24:02.163 INFO:tasks.rados.rados.0.smithi175.stdout:49: writing smithi17529564-49 from 442368 to 819200 tid 2 2024-04-26T02:24:02.163 INFO:tasks.rados.rados.0.smithi175.stdout:50: write initial oid 50 2024-04-26T02:24:02.163 INFO:tasks.rados.rados.0.smithi175.stdout:50: seq_num 49 ranges {0=458752,458752=376832} 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:50: writing smithi17529564-50 from 0 to 458752 tid 1 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:50: writing smithi17529564-50 from 458752 to 835584 tid 2 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:51: snap_create 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:40: finishing write tid 2 to smithi17529564-40 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:40: finishing write tid 3 to smithi17529564-40 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:40: oid 40 updating version 0 to 7 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:40: oid 40 updating version 7 to 8 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 40 v 8 (ObjNum 39 snap 0 seq_num 39) dirty exists 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:41: finishing write tid 1 to smithi17529564-41 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:41: finishing write tid 2 to smithi17529564-41 2024-04-26T02:24:02.169 INFO:tasks.rados.rados.0.smithi175.stdout:41: finishing write tid 3 to smithi17529564-41 2024-04-26T02:24:02.170 INFO:tasks.rados.rados.0.smithi175.stdout:41: oid 41 updating version 0 to 9 2024-04-26T02:24:02.170 INFO:tasks.rados.rados.0.smithi175.stdout:41: oid 41 updating version 9 to 10 2024-04-26T02:24:02.170 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 41 v 10 (ObjNum 40 snap 0 seq_num 40) dirty exists 2024-04-26T02:24:02.171 INFO:tasks.rados.rados.0.smithi175.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2024-04-26T02:24:02.171 INFO:tasks.rados.rados.0.smithi175.stdout:42: finishing write tid 1 to smithi17529564-42 2024-04-26T02:24:02.171 INFO:tasks.rados.rados.0.smithi175.stdout:42: finishing write tid 2 to smithi17529564-42 2024-04-26T02:24:02.171 INFO:tasks.rados.rados.0.smithi175.stdout:42: finishing write tid 3 to smithi17529564-42 2024-04-26T02:24:02.171 INFO:tasks.rados.rados.0.smithi175.stdout:42: oid 42 updating version 0 to 11 2024-04-26T02:24:02.171 INFO:tasks.rados.rados.0.smithi175.stdout:42: oid 42 updating version 11 to 12 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 42 v 12 (ObjNum 41 snap 0 seq_num 41) dirty exists 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:43: finishing write tid 1 to smithi17529564-43 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:43: finishing write tid 2 to smithi17529564-43 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:43: finishing write tid 3 to smithi17529564-43 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:43: oid 43 updating version 0 to 3 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:43: oid 43 updating version 3 to 4 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 43 v 4 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:44: finishing write tid 1 to smithi17529564-44 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:44: finishing write tid 2 to smithi17529564-44 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:44: finishing write tid 3 to smithi17529564-44 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:44: oid 44 updating version 0 to 8 2024-04-26T02:24:02.172 INFO:tasks.rados.rados.0.smithi175.stdout:44: oid 44 version 8 is already newer than 7 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 44 v 8 (ObjNum 43 snap 0 seq_num 43) dirty exists 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:45: finishing write tid 1 to smithi17529564-45 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:45: finishing write tid 2 to smithi17529564-45 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:46: finishing write tid 1 to smithi17529564-46 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:46: finishing write tid 2 to smithi17529564-46 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:45: finishing write tid 3 to smithi17529564-45 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:45: oid 45 updating version 0 to 5 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:45: oid 45 updating version 5 to 6 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 45 v 6 (ObjNum 44 snap 0 seq_num 44) dirty exists 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:46: finishing write tid 3 to smithi17529564-46 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:46: oid 46 updating version 0 to 14 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:46: oid 46 version 14 is already newer than 13 2024-04-26T02:24:02.173 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 46 v 14 (ObjNum 45 snap 0 seq_num 45) dirty exists 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: finishing write tid 1 to smithi17529564-48 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: finishing write tid 2 to smithi17529564-48 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:49: finishing write tid 1 to smithi17529564-49 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: finishing write tid 3 to smithi17529564-48 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: finishing write tid 4 to smithi17529564-48 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: oid 48 updating version 0 to 7 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: oid 48 version 7 is already newer than 5 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: oid 48 version 7 is already newer than 6 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 48 v 7 (ObjNum 47 snap 0 seq_num 47) dirty exists 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2024-04-26T02:24:02.174 INFO:tasks.rados.rados.0.smithi175.stdout:49: finishing write tid 2 to smithi17529564-49 2024-04-26T02:24:02.176 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:02.176 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:49: finishing write tid 3 to smithi17529564-49 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:50: finishing write tid 1 to smithi17529564-50 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:49: finishing write tid 4 to smithi17529564-49 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:49: oid 49 updating version 0 to 8 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:49: oid 49 updating version 8 to 9 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:49: oid 49 version 9 is already newer than 7 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 49 v 9 (ObjNum 48 snap 0 seq_num 48) dirty exists 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2024-04-26T02:24:02.177 INFO:tasks.rados.rados.0.smithi175.stdout:50: finishing write tid 2 to smithi17529564-50 2024-04-26T02:24:02.178 INFO:tasks.rados.rados.0.smithi175.stdout:50: finishing write tid 3 to smithi17529564-50 2024-04-26T02:24:02.178 INFO:tasks.rados.rados.0.smithi175.stdout:50: finishing write tid 4 to smithi17529564-50 2024-04-26T02:24:02.178 INFO:tasks.rados.rados.0.smithi175.stdout:50: oid 50 updating version 0 to 15 2024-04-26T02:24:02.178 INFO:tasks.rados.rados.0.smithi175.stdout:50: oid 50 updating version 15 to 16 2024-04-26T02:24:02.178 INFO:tasks.rados.rados.0.smithi175.stdout:50: oid 50 updating version 16 to 17 2024-04-26T02:24:02.178 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 50 v 17 (ObjNum 49 snap 0 seq_num 49) dirty exists 2024-04-26T02:24:02.178 INFO:tasks.rados.rados.0.smithi175.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2024-04-26T02:24:02.179 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:02.172+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:02.186 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:02.263 INFO:tasks.rados.rados.0.smithi175.stdout:21: finishing write tid 1 to smithi17529564-21 2024-04-26T02:24:02.267 INFO:tasks.rados.rados.0.smithi175.stdout:21: finishing write tid 2 to smithi17529564-21 2024-04-26T02:24:02.271 INFO:tasks.rados.rados.0.smithi175.stdout:28: finishing write tid 1 to smithi17529564-28 2024-04-26T02:24:02.272 INFO:tasks.rados.rados.0.smithi175.stdout:28: finishing write tid 2 to smithi17529564-28 2024-04-26T02:24:02.277 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:02.272+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:02.278 INFO:tasks.rados.rados.0.smithi175.stdout:21: finishing write tid 3 to smithi17529564-21 2024-04-26T02:24:02.278 INFO:tasks.rados.rados.0.smithi175.stdout:21: oid 21 updating version 0 to 1 2024-04-26T02:24:02.278 INFO:tasks.rados.rados.0.smithi175.stdout:21: oid 21 updating version 1 to 2 2024-04-26T02:24:02.278 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 21 v 2 (ObjNum 20 snap 0 seq_num 20) dirty exists 2024-04-26T02:24:02.279 INFO:tasks.rados.rados.0.smithi175.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2024-04-26T02:24:02.280 INFO:tasks.rados.rados.0.smithi175.stdout:28: finishing write tid 3 to smithi17529564-28 2024-04-26T02:24:02.280 INFO:tasks.rados.rados.0.smithi175.stdout:28: oid 28 updating version 0 to 3 2024-04-26T02:24:02.280 INFO:tasks.rados.rados.0.smithi175.stdout:28: oid 28 updating version 3 to 4 2024-04-26T02:24:02.280 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 28 v 4 (ObjNum 27 snap 0 seq_num 27) dirty exists 2024-04-26T02:24:02.280 INFO:tasks.rados.rados.0.smithi175.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2024-04-26T02:24:02.281 INFO:tasks.rados.rados.0.smithi175.stdout:47: finishing write tid 1 to smithi17529564-47 2024-04-26T02:24:02.281 INFO:tasks.rados.rados.0.smithi175.stdout:47: finishing write tid 2 to smithi17529564-47 2024-04-26T02:24:02.286 INFO:tasks.rados.rados.0.smithi175.stdout:47: finishing write tid 3 to smithi17529564-47 2024-04-26T02:24:02.286 INFO:tasks.rados.rados.0.smithi175.stdout:47: oid 47 updating version 0 to 6 2024-04-26T02:24:02.286 INFO:tasks.rados.rados.0.smithi175.stdout:47: oid 47 version 6 is already newer than 5 2024-04-26T02:24:02.286 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 6 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-04-26T02:24:02.286 INFO:tasks.rados.rados.0.smithi175.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2024-04-26T02:24:02.313 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:02.313 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:02.330 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:02.378 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:02.375+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:02.453 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:02.453 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:02.467 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:02.479 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:02.476+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:02.580 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:02.576+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:02.634 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:02.634 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:02.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:02.681 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:02.680+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:02.773 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:02.774 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:02.782 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:02.779+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:02.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:02.883 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:02.880+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:02.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:03.006 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:21: done (13 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:28: done (12 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:40: done (11 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:41: done (10 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:42: done (9 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:43: done (8 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:44: done (7 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:45: done (6 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:46: done (5 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:47: done (4 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:48: done (3 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:49: done (2 left) 2024-04-26T02:24:03.015 INFO:tasks.rados.rados.0.smithi175.stdout:50: done (1 left) 2024-04-26T02:24:03.016 INFO:tasks.rados.rados.0.smithi175.stdout:51: done (0 left) 2024-04-26T02:24:03.016 INFO:tasks.rados.rados.0.smithi175.stdout:52: rollback oid 4 current snap is 1 2024-04-26T02:24:03.016 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 4 to 0 2024-04-26T02:24:03.016 INFO:tasks.rados.rados.0.smithi175.stdout:53: read oid 48 snap -1 2024-04-26T02:24:03.016 INFO:tasks.rados.rados.0.smithi175.stdout:53: expect (ObjNum 47 snap 0 seq_num 47) 2024-04-26T02:24:03.016 INFO:tasks.rados.rados.0.smithi175.stdout:54: snap_create 2024-04-26T02:24:03.017 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:03.011+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:03.021 INFO:tasks.rados.rados.0.smithi175.stdout:52: finishing rollback tid 0 to smithi17529564-4 2024-04-26T02:24:03.022 INFO:tasks.rados.rados.0.smithi175.stdout:52: finishing rollback tid 1 to smithi17529564-4 2024-04-26T02:24:03.025 INFO:tasks.rados.rados.0.smithi175.stdout:52: finishing rollback tid 2 to smithi17529564-4 2024-04-26T02:24:03.025 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 10 (ObjNum 3 snap 0 seq_num 3) dirty exists 2024-04-26T02:24:03.030 INFO:tasks.rados.rados.0.smithi175.stdout:53: expect (ObjNum 47 snap 0 seq_num 47) 2024-04-26T02:24:03.086 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:03.084+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:03.106 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:03.187 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:03.184+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:03.270 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:03.270 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:03.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:03.288 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:03.284+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:03.389 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:03.388+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:03.407 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:03.407 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:03.422 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:24:03.490 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:03.487+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:03.543 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:03.558 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:24:03.591 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:03.588+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:03.692 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:03.688+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:03.727 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:03.727 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:03.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:24:03.793 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:03.791+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:03.859 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:03.859 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:03.873 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:24:03.895 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:03.888+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:03.995 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:03.992+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:04.022 INFO:tasks.rados.rados.0.smithi175.stdout:52: done (2 left) 2024-04-26T02:24:04.022 INFO:tasks.rados.rados.0.smithi175.stdout:53: done (1 left) 2024-04-26T02:24:04.022 INFO:tasks.rados.rados.0.smithi175.stdout:54: done (0 left) 2024-04-26T02:24:04.022 INFO:tasks.rados.rados.0.smithi175.stdout:55: rmattr oid 39 current snap is 2 2024-04-26T02:24:04.022 INFO:tasks.rados.rados.0.smithi175.stdout:55: done (0 left) 2024-04-26T02:24:04.022 INFO:tasks.rados.rados.0.smithi175.stdout:56: setattr oid 19 current snap is 2 2024-04-26T02:24:04.023 INFO:tasks.rados.rados.0.smithi175.stdout:57: rmattr oid 6 current snap is 2 2024-04-26T02:24:04.024 INFO:tasks.rados.rados.0.smithi175.stdout:57: done (1 left) 2024-04-26T02:24:04.024 INFO:tasks.rados.rados.0.smithi175.stdout:58: setattr oid 26 current snap is 2 2024-04-26T02:24:04.025 INFO:tasks.rados.rados.0.smithi175.stdout:59: setattr oid 15 current snap is 2 2024-04-26T02:24:04.028 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 27 current snap is 2 2024-04-26T02:24:04.028 INFO:tasks.rados.rados.0.smithi175.stdout:60: seq_num 50 ranges {442368=475136,917504=376832} 2024-04-26T02:24:04.034 INFO:tasks.rados.rados.0.smithi175.stdout:60: writing smithi17529564-27 from 442368 to 917504 tid 1 2024-04-26T02:24:04.037 INFO:tasks.rados.rados.0.smithi175.stdout:60: writing smithi17529564-27 from 917504 to 1294336 tid 2 2024-04-26T02:24:04.037 INFO:tasks.rados.rados.0.smithi175.stdout:61: copy_from oid 35 from oid 10 current snap is 2 2024-04-26T02:24:04.037 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 26 v 12 (ObjNum 25 snap 0 seq_num 25) dirty exists 2024-04-26T02:24:04.037 INFO:tasks.rados.rados.0.smithi175.stdout:58: done (4 left) 2024-04-26T02:24:04.037 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 8 current snap is 2 2024-04-26T02:24:04.037 INFO:tasks.rados.rados.0.smithi175.stdout:62: seq_num 51 ranges {131072=491520,622592=376832} 2024-04-26T02:24:04.043 INFO:tasks.rados.rados.0.smithi175.stdout:62: writing smithi17529564-8 from 131072 to 622592 tid 1 2024-04-26T02:24:04.046 INFO:tasks.rados.rados.0.smithi175.stdout:62: writing smithi17529564-8 from 622592 to 999424 tid 2 2024-04-26T02:24:04.047 INFO:tasks.rados.rados.0.smithi175.stdout:63: rmattr oid 17 current snap is 2 2024-04-26T02:24:04.047 INFO:tasks.rados.rados.0.smithi175.stdout:64: delete oid 21 current snap is 2 2024-04-26T02:24:04.047 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 19 v 8 (ObjNum 18 snap 0 seq_num 18) dirty exists 2024-04-26T02:24:04.047 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 15 v 10 (ObjNum 14 snap 0 seq_num 14) dirty exists 2024-04-26T02:24:04.047 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 17 v 0 (ObjNum 16 snap 0 seq_num 16) dirty exists 2024-04-26T02:24:04.047 INFO:tasks.rados.rados.0.smithi175.stdout:60: finishing write tid 1 to smithi17529564-27 2024-04-26T02:24:04.049 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:04.049 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:04.052 INFO:tasks.rados.rados.0.smithi175.stdout:56: done (6 left) 2024-04-26T02:24:04.052 INFO:tasks.rados.rados.0.smithi175.stdout:59: done (5 left) 2024-04-26T02:24:04.052 INFO:tasks.rados.rados.0.smithi175.stdout:63: done (4 left) 2024-04-26T02:24:04.052 INFO:tasks.rados.rados.0.smithi175.stdout:64: done (3 left) 2024-04-26T02:24:04.052 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 46 current snap is 2 2024-04-26T02:24:04.052 INFO:tasks.rados.rados.0.smithi175.stdout:65: seq_num 53 ranges {770048=524288,1294336=376832} 2024-04-26T02:24:04.063 INFO:tasks.rados.rados.0.smithi175.stdout:65: writing smithi17529564-46 from 770048 to 1294336 tid 1 2024-04-26T02:24:04.066 INFO:tasks.rados.rados.0.smithi175.stdout:65: writing smithi17529564-46 from 1294336 to 1671168 tid 2 2024-04-26T02:24:04.066 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 38 current snap is 2 2024-04-26T02:24:04.066 INFO:tasks.rados.rados.0.smithi175.stdout:60: finishing write tid 2 to smithi17529564-27 2024-04-26T02:24:04.066 INFO:tasks.rados.rados.0.smithi175.stdout:60: finishing write tid 3 to smithi17529564-27 2024-04-26T02:24:04.066 INFO:tasks.rados.rados.0.smithi175.stdout:61: finishing copy_from racing read to smithi17529564-35 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:62: finishing write tid 1 to smithi17529564-8 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:60: finishing write tid 4 to smithi17529564-27 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:60: oid 27 updating version 0 to 10 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:60: oid 27 version 10 is already newer than 8 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:60: oid 27 version 10 is already newer than 9 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 27 v 10 (ObjNum 50 snap 2 seq_num 50) dirty exists 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:60: left oid 27 (ObjNum 50 snap 2 seq_num 50) 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:61: finishing copy_from to smithi17529564-35 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 35 v 4 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:62: finishing write tid 2 to smithi17529564-8 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:62: finishing write tid 3 to smithi17529564-8 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:62: finishing write tid 4 to smithi17529564-8 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:62: oid 8 updating version 0 to 13 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:62: oid 8 version 13 is already newer than 11 2024-04-26T02:24:04.067 INFO:tasks.rados.rados.0.smithi175.stdout:62: oid 8 version 13 is already newer than 12 2024-04-26T02:24:04.068 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 8 v 13 (ObjNum 51 snap 2 seq_num 51) dirty exists 2024-04-26T02:24:04.068 INFO:tasks.rados.rados.0.smithi175.stdout:62: left oid 8 (ObjNum 51 snap 2 seq_num 51) 2024-04-26T02:24:04.068 INFO:tasks.rados.rados.0.smithi175.stdout:66: seq_num 54 ranges {622592=540672,1163264=376832} 2024-04-26T02:24:04.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:24:04.075 INFO:tasks.rados.rados.0.smithi175.stdout:66: writing smithi17529564-38 from 622592 to 1163264 tid 1 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:66: writing smithi17529564-38 from 1163264 to 1540096 tid 2 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:60: done (4 left) 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:61: done (3 left) 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:62: done (2 left) 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:67: read oid 44 snap 1 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:67: expect (ObjNum 43 snap 0 seq_num 43) 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:68: delete oid 40 current snap is 2 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:65: finishing write tid 1 to smithi17529564-46 2024-04-26T02:24:04.079 INFO:tasks.rados.rados.0.smithi175.stdout:65: finishing write tid 2 to smithi17529564-46 2024-04-26T02:24:04.080 INFO:tasks.rados.rados.0.smithi175.stdout:65: finishing write tid 3 to smithi17529564-46 2024-04-26T02:24:04.081 INFO:tasks.rados.rados.0.smithi175.stdout:65: finishing write tid 4 to smithi17529564-46 2024-04-26T02:24:04.081 INFO:tasks.rados.rados.0.smithi175.stdout:65: oid 46 updating version 0 to 21 2024-04-26T02:24:04.081 INFO:tasks.rados.rados.0.smithi175.stdout:65: oid 46 version 21 is already newer than 19 2024-04-26T02:24:04.081 INFO:tasks.rados.rados.0.smithi175.stdout:65: oid 46 version 21 is already newer than 20 2024-04-26T02:24:04.081 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 46 v 21 (ObjNum 53 snap 2 seq_num 53) dirty exists 2024-04-26T02:24:04.081 INFO:tasks.rados.rados.0.smithi175.stdout:65: left oid 46 (ObjNum 53 snap 2 seq_num 53) 2024-04-26T02:24:04.087 INFO:tasks.rados.rados.0.smithi175.stdout:66: finishing write tid 1 to smithi17529564-38 2024-04-26T02:24:04.088 INFO:tasks.rados.rados.0.smithi175.stdout:66: finishing write tid 2 to smithi17529564-38 2024-04-26T02:24:04.089 INFO:tasks.rados.rados.0.smithi175.stdout:66: finishing write tid 3 to smithi17529564-38 2024-04-26T02:24:04.089 INFO:tasks.rados.rados.0.smithi175.stdout:67: expect (ObjNum 43 snap 0 seq_num 43) 2024-04-26T02:24:04.096 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:04.092+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:04.110 INFO:tasks.rados.rados.0.smithi175.stdout:66: finishing write tid 4 to smithi17529564-38 2024-04-26T02:24:04.110 INFO:tasks.rados.rados.0.smithi175.stdout:66: oid 38 updating version 0 to 13 2024-04-26T02:24:04.111 INFO:tasks.rados.rados.0.smithi175.stdout:66: oid 38 updating version 13 to 14 2024-04-26T02:24:04.111 INFO:tasks.rados.rados.0.smithi175.stdout:66: oid 38 version 14 is already newer than 12 2024-04-26T02:24:04.111 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 38 v 14 (ObjNum 54 snap 2 seq_num 54) dirty exists 2024-04-26T02:24:04.111 INFO:tasks.rados.rados.0.smithi175.stdout:66: left oid 38 (ObjNum 54 snap 2 seq_num 54) 2024-04-26T02:24:04.111 INFO:tasks.rados.rados.0.smithi175.stdout:65: done (3 left) 2024-04-26T02:24:04.111 INFO:tasks.rados.rados.0.smithi175.stdout:66: done (2 left) 2024-04-26T02:24:04.111 INFO:tasks.rados.rados.0.smithi175.stdout:67: done (1 left) 2024-04-26T02:24:04.112 INFO:tasks.rados.rados.0.smithi175.stdout:68: done (0 left) 2024-04-26T02:24:04.112 INFO:tasks.rados.rados.0.smithi175.stdout:69: rollback oid 13 current snap is 2 2024-04-26T02:24:04.112 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 13 to 1 2024-04-26T02:24:04.112 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 26 current snap is 2 2024-04-26T02:24:04.112 INFO:tasks.rados.rados.0.smithi175.stdout:70: seq_num 56 ranges {425984=573440,999424=376832} 2024-04-26T02:24:04.118 INFO:tasks.rados.rados.0.smithi175.stdout:70: writing smithi17529564-26 from 425984 to 999424 tid 1 2024-04-26T02:24:04.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:04.121 INFO:tasks.rados.rados.0.smithi175.stdout:70: writing smithi17529564-26 from 999424 to 1376256 tid 2 2024-04-26T02:24:04.121 INFO:tasks.rados.rados.0.smithi175.stdout:71: snap_remove snap 0 2024-04-26T02:24:04.197 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:04.195+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:04.214 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:04.214 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:04.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:24:04.263 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:04.263 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:04.284 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:04.284 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:04.298 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:04.292+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:04.305 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:04.305 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:04.325 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:04.326 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:04.342 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:04.343 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:04.345 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:04.345 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:04.346 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:04.346 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:04.346 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:04.360 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:24:04.363 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:04.385 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:04.399 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:04.399+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:04.406 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:04.406 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:04.440 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:04.441 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:04.478 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:04.500 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:04.496+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:04.514 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:04.514 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:04.523 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:04.523 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [] 2024-04-26T02:24:04.523 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:04.535 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:04.535 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:04.537 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:24:04.553 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:04.554 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:04.574 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:04.575 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:04.595 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:04.595 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:04.601 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:04.596+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:04.616 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:04.616 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:04.671 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:04.671 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:04.672 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:04.672 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:04.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:24:04.728 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:04.724+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:04.802 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:04.796+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:04.850 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:04.851 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:04.851 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:04.851 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:04.851 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:04.865 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:24:04.904 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:04.900+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:04.985 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:04.985 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [] 2024-04-26T02:24:04.985 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:05.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:24:05.006 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:05.000+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:05.030 INFO:tasks.rados.rados.0.smithi175.stdout:71: done (2 left) 2024-04-26T02:24:05.030 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 38 current snap is 2 2024-04-26T02:24:05.031 INFO:tasks.rados.rados.0.smithi175.stdout:69: finishing rollback tid 0 to smithi17529564-13 2024-04-26T02:24:05.031 INFO:tasks.rados.rados.0.smithi175.stdout:69: finishing rollback tid 1 to smithi17529564-13 2024-04-26T02:24:05.031 INFO:tasks.rados.rados.0.smithi175.stdout:69: finishing rollback tid 2 to smithi17529564-13 2024-04-26T02:24:05.031 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 13 v 25 (ObjNum 12 snap 0 seq_num 12) dirty exists 2024-04-26T02:24:05.031 INFO:tasks.rados.rados.0.smithi175.stdout:70: finishing write tid 1 to smithi17529564-26 2024-04-26T02:24:05.031 INFO:tasks.rados.rados.0.smithi175.stdout:72: seq_num 57 ranges {1540096=589824,2129920=376832} 2024-04-26T02:24:05.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:24:05.059 INFO:tasks.rados.rados.0.smithi175.stdout:72: writing smithi17529564-38 from 1540096 to 2129920 tid 1 2024-04-26T02:24:05.063 INFO:tasks.rados.rados.0.smithi175.stdout:72: writing smithi17529564-38 from 2129920 to 2506752 tid 2 2024-04-26T02:24:05.063 INFO:tasks.rados.rados.0.smithi175.stdout:69: done (2 left) 2024-04-26T02:24:05.063 INFO:tasks.rados.rados.0.smithi175.stdout:73: delete oid 30 current snap is 2 2024-04-26T02:24:05.063 INFO:tasks.rados.rados.0.smithi175.stdout:70: finishing write tid 2 to smithi17529564-26 2024-04-26T02:24:05.064 INFO:tasks.rados.rados.0.smithi175.stdout:70: finishing write tid 3 to smithi17529564-26 2024-04-26T02:24:05.064 INFO:tasks.rados.rados.0.smithi175.stdout:70: finishing write tid 4 to smithi17529564-26 2024-04-26T02:24:05.064 INFO:tasks.rados.rados.0.smithi175.stdout:70: oid 26 updating version 0 to 15 2024-04-26T02:24:05.064 INFO:tasks.rados.rados.0.smithi175.stdout:70: oid 26 version 15 is already newer than 13 2024-04-26T02:24:05.064 INFO:tasks.rados.rados.0.smithi175.stdout:70: oid 26 version 15 is already newer than 14 2024-04-26T02:24:05.064 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 26 v 15 (ObjNum 56 snap 2 seq_num 56) dirty exists 2024-04-26T02:24:05.064 INFO:tasks.rados.rados.0.smithi175.stdout:70: left oid 26 (ObjNum 56 snap 2 seq_num 56) 2024-04-26T02:24:05.069 INFO:tasks.rados.rados.0.smithi175.stdout:72: finishing write tid 1 to smithi17529564-38 2024-04-26T02:24:05.069 INFO:tasks.rados.rados.0.smithi175.stdout:70: done (2 left) 2024-04-26T02:24:05.069 INFO:tasks.rados.rados.0.smithi175.stdout:73: done (1 left) 2024-04-26T02:24:05.069 INFO:tasks.rados.rados.0.smithi175.stdout:74: snap_remove snap 1 2024-04-26T02:24:05.106 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:05.100+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:05.141 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:05.141 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:05.142 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:05.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:24:05.207 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:05.207+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:05.277 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:05.277 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:05.277 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:05.277 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:05.277 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:05.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:24:05.343 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:05.340+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:05.408 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:05.407+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:05.414 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:05.414 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:05.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:05.414 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:05.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.414 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as6 37/31 ECSubWrite(tid=43, reqid=osd.12.0:43, at_version=37'17, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:05.414 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.028999+0000", 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.38244851699999999, 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001657108, 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.028999+0000", 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.028999+0000", 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029000+0000", 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5900000000000002e-07 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029024+0000", 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4522999999999999e-05 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029034+0000", 2024-04-26T02:24:05.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5279999999999992e-06 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029045+0000", 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1026000000000001e-05 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029152+0000", 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000106909 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029163+0000", 2024-04-26T02:24:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1449e-05 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030599+0000", 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014355940000000001 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030657+0000", 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7620000000000001e-05 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.418 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as6 37/31 ECSubWrite(tid=44, reqid=osd.12.0:44, at_version=37'19, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.030603+0000", 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.38084489900000001, 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022783840000000001, 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030603+0000", 2024-04-26T02:24:05.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030603+0000", 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030605+0000", 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.446e-06 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030636+0000", 2024-04-26T02:24:05.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1489999999999998e-05 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030653+0000", 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6511000000000002e-05 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030664+0000", 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1472e-05 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030764+0000", 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9727000000000002e-05 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030777+0000", 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3005e-05 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032805+0000", 2024-04-26T02:24:05.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020280749999999998 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032881+0000", 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6657999999999997e-05 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.423 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as6 37/31 ECSubWrite(tid=45, reqid=osd.12.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.038907+0000", 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.37254094799999998, 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042014119999999999, 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038907+0000", 2024-04-26T02:24:05.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038907+0000", 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038908+0000", 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0869999999999999e-06 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038922+0000", 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4226999999999999e-05 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038945+0000", 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2909999999999999e-05 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038955+0000", 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0169999999999999e-05 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039064+0000", 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108826 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039076+0000", 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2086000000000001e-05 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043004+0000", 2024-04-26T02:24:05.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039272559999999996 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043108+0000", 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010485 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=26, last_complete=37'20, committed=1, applied=1))", 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.046208+0000", 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.36524021099999998, 2024-04-26T02:24:05.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00075332199999999995, 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046208+0000", 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046208+0000", 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046209+0000", 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2200000000000003e-07 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046213+0000", 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8709999999999996e-06 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046227+0000", 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3091999999999999e-05 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046233+0000", 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3820000000000001e-06 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046305+0000", 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1638999999999996e-05 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.046961+0000", 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000656516 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=28, last_complete=37'22, committed=1, applied=1))", 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.051064+0000", 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.36038376300000002, 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028706499999999998, 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051064+0000", 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051064+0000", 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051065+0000", 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7999999999999993e-07 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051071+0000", 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0900000000000001e-06 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051089+0000", 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7368e-05 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051099+0000", 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0301e-05 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051333+0000", 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023430599999999999 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.051351+0000", 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.802e-05 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.436 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=28, last_complete=37'22, committed=1, applied=1))", 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.053275+0000", 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.35817339799999998, 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028350700000000001, 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053275+0000", 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053275+0000", 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053275+0000", 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0599999999999999e-07 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053276+0000", 2024-04-26T02:24:05.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5629999999999999e-06 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053280+0000", 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0679999999999998e-06 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053283+0000", 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8370000000000001e-06 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053518+0000", 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023464499999999999 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.053558+0000", 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0188000000000002e-05 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=28, last_complete=37'22, committed=1, applied=1))", 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.055593+0000", 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.35585496900000002, 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00052631300000000004, 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.055593+0000", 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.055593+0000", 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.055594+0000", 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9699999999999995e-07 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.055599+0000", 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8910000000000003e-06 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.055614+0000", 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5316999999999999e-05 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.055622+0000", 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0409999999999998e-06 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.055699+0000", 2024-04-26T02:24:05.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7334000000000002e-05 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056119+0000", 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00042003299999999999 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:197 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~589824] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:05.447 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.35277164900000002, 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01132682, 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 197 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058678+0000", 2024-04-26T02:24:05.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1119999999999999e-06 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059820+0000", 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011419329999999999 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059838+0000", 2024-04-26T02:24:05.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7312e-05 2024-04-26T02:24:05.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059849+0000", 2024-04-26T02:24:05.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1066999999999999e-05 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060084+0000", 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023474499999999999 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060231+0000", 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014785699999999999 2024-04-26T02:24:05.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061250+0000", 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00101822 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.063642+0000", 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00239267 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:05.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069912+0000", 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006269546 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070003+0000", 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1358000000000002e-05 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=29, last_complete=37'22, committed=1, applied=1))", 2024-04-26T02:24:05.454 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.061332+0000", 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.35011600999999998, 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00097889200000000009, 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061332+0000", 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061332+0000", 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061333+0000", 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5700000000000002e-07 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061337+0000", 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4680000000000003e-06 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061347+0000", 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0318e-05 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061365+0000", 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7306e-05 2024-04-26T02:24:05.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.062298+0000", 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000933185 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.062311+0000", 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2958e-05 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=29, last_complete=37'22, committed=1, applied=1))", 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.061415+0000", 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.35003346800000001, 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00099687400000000002, 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061415+0000", 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061415+0000", 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061415+0000", 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6300000000000005e-07 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061419+0000", 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0570000000000003e-06 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061448+0000", 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8357e-05 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061455+0000", 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4580000000000004e-06 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.062385+0000", 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00093033700000000005 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.062411+0000", 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6001999999999999e-05 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=29, last_complete=37'22, committed=1, applied=1))", 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.061550+0000", 2024-04-26T02:24:05.462 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34989805800000001, 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00097810400000000004, 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061550+0000", 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061550+0000", 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061551+0000", 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2399999999999997e-07 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061556+0000", 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2340000000000002e-06 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061572+0000", 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6248000000000001e-05 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061582+0000", 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2660000000000007e-06 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.062469+0000", 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000887111 2024-04-26T02:24:05.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.062528+0000", 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9420999999999999e-05 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:198 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~376832] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064330+0000", 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34711796299999997, 2024-04-26T02:24:05.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070653950000000004, 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 198 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064330+0000", 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064330+0000", 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064332+0000", 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9400000000000001e-06 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064739+0000", 2024-04-26T02:24:05.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040711300000000002 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064751+0000", 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1963e-05 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064761+0000", 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.039e-05 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.469 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064849+0000", 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7519e-05 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064990+0000", 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014100399999999999 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.066057+0000", 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001067094 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069765+0000", 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037077049999999999 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071333+0000", 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001568255 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071395+0000", 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2411999999999998e-05 2024-04-26T02:24:05.471 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:199 3.5s0 3:a5f188bf:::smithi17529564-38:head [setxattr _header (56) in=7b] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064776+0000", 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34667199900000001, 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726609999999997, 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:05.472 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 199 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064776+0000", 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064776+0000", 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064777+0000", 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7499999999999999e-07 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064780+0000", 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5870000000000001e-06 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064793+0000", 2024-04-26T02:24:05.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2836e-05 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064797+0000", 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.613e-06 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.066888+0000", 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020912869999999998 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:05.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067018+0000", 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012998600000000001 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067648+0000", 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00063017399999999995 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070033+0000", 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023843100000000002 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:05.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071957+0000", 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001924006 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072049+0000", 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2087000000000001e-05 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:200 3.5s0 3:a5f188bf:::smithi17529564-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:05.477 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34661598100000002, 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094044490000000005, 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 200 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:05.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7700000000000005e-07 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064835+0000", 2024-04-26T02:24:05.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6929999999999999e-06 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064844+0000", 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1919999999999994e-06 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064850+0000", 2024-04-26T02:24:05.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0610000000000001e-06 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068037+0000", 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031864490000000001 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068091+0000", 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4273e-05 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072664+0000", 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004572932 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072801+0000", 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013716100000000001 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.074236+0000", 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001435211 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=30, last_complete=37'23, committed=1, applied=1))", 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.065031+0000", 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34641680499999999, 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029784120000000002, 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065031+0000", 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065031+0000", 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065032+0000", 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5900000000000003e-07 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065034+0000", 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4760000000000001e-06 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065040+0000", 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9390000000000002e-06 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065044+0000", 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.771e-06 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067996+0000", 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029520179999999998 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068010+0000", 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3849000000000001e-05 2024-04-26T02:24:05.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds4 37/31 ECSubWrite(tid=46, reqid=client.4589.0:201, at_version=37'12, trim_to=0'0, roll_forward_to=34'10))", 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.065955+0000", 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34549260300000001, 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041089270000000001, 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065955+0000", 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065955+0000", 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065956+0000", 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3500000000000005e-07 2024-04-26T02:24:05.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065979+0000", 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2802e-05 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065993+0000", 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3791999999999999e-05 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.066002+0000", 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0650000000000005e-06 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067991+0000", 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019891150000000001 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068003+0000", 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1721e-05 2024-04-26T02:24:05.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070035+0000", 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002031691 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070064+0000", 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9805999999999999e-05 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=31, last_complete=37'24, committed=1, applied=1))", 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.069232+0000", 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.342215565, 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053365300000000004, 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069232+0000", 2024-04-26T02:24:05.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069232+0000", 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069233+0000", 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0800000000000005e-07 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069236+0000", 2024-04-26T02:24:05.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.689e-06 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069271+0000", 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4881e-05 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069275+0000", 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5379999999999996e-06 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069745+0000", 2024-04-26T02:24:05.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00046988500000000002 2024-04-26T02:24:05.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069766+0000", 2024-04-26T02:24:05.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1152e-05 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=30, last_complete=37'23, committed=1, applied=1))", 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.069679+0000", 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34176934799999997, 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038888699999999998, 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.496 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069679+0000", 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069679+0000", 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069680+0000", 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.054e-06 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069686+0000", 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.669e-06 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069702+0000", 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5392000000000001e-05 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069726+0000", 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4097999999999999e-05 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069834+0000", 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000108324 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070068+0000", 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023335000000000001 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds4 37/31 ECSubWrite(tid=47, reqid=client.4589.0:201, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.070808+0000", 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.34063955400000001, 2024-04-26T02:24:05.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015674980000000001, 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070808+0000", 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070808+0000", 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070809+0000", 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.16e-07 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070821+0000", 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1338000000000001e-05 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070840+0000", 2024-04-26T02:24:05.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9601000000000001e-05 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070850+0000", 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3940000000000002e-06 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070941+0000", 2024-04-26T02:24:05.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1407000000000001e-05 2024-04-26T02:24:05.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070952+0000", 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1117e-05 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072344+0000", 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001392141 2024-04-26T02:24:05.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072376+0000", 2024-04-26T02:24:05.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1683999999999997e-05 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 37/31 ECSubWriteReply(tid=32, last_complete=37'25, committed=1, applied=1))", 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.071758+0000", 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.339689941, 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00058324600000000005, 2024-04-26T02:24:05.507 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071758+0000", 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071758+0000", 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071759+0000", 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3300000000000001e-07 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071765+0000", 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7169999999999996e-06 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071780+0000", 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5738000000000001e-05 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071795+0000", 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4524e-05 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071877+0000", 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1685000000000001e-05 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:05.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072341+0000", 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00046474899999999998 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:05.511 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:05.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:24:05.513 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:05.512+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:05.613 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:05.608+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:05.684 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:05.685 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:05.685 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:05.685 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:05.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:24:05.743 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:05.740+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:05.816 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:05.812+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:05.868 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:05.868 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:05.869 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:05.869 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:05.869 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:05.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:24:05.917 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:05.912+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:06.019 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:06.012+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:06.026 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:24:06.032 INFO:tasks.rados.rados.0.smithi175.stdout:74: done (1 left) 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:75: read oid 5 snap -1 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:75: expect (ObjNum 4 snap 0 seq_num 4) 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:72: finishing write tid 2 to smithi17529564-38 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:72: finishing write tid 3 to smithi17529564-38 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:72: finishing write tid 4 to smithi17529564-38 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:72: oid 38 updating version 0 to 25 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:72: oid 38 version 25 is already newer than 24 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:72: oid 38 version 25 is already newer than 23 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 38 v 25 (ObjNum 57 snap 2 seq_num 57) dirty exists 2024-04-26T02:24:06.033 INFO:tasks.rados.rados.0.smithi175.stdout:72: left oid 38 (ObjNum 57 snap 2 seq_num 57) 2024-04-26T02:24:06.034 INFO:tasks.rados.rados.0.smithi175.stdout:72: done (1 left) 2024-04-26T02:24:06.034 INFO:tasks.rados.rados.0.smithi175.stdout:76: snap_create 2024-04-26T02:24:06.054 INFO:tasks.rados.rados.0.smithi175.stdout:75: expect (ObjNum 4 snap 0 seq_num 4) 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 36/31 ECSubWriteReply(tid=43, last_complete=37'17, committed=1, applied=1))", 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.030735+0000", 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0315057219999999, 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038546499999999998, 2024-04-26T02:24:06.064 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030735+0000", 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030735+0000", 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030736+0000", 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.04e-06 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030741+0000", 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5399999999999997e-06 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030753+0000", 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2024999999999999e-05 2024-04-26T02:24:06.066 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.030762+0000", 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8959999999999992e-06 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.031094+0000", 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00033228499999999998 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.031121+0000", 2024-04-26T02:24:06.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6679e-05 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=43, last_complete=37'17, committed=1, applied=1))", 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.032194+0000", 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0300476009999999, 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016314300000000001, 2024-04-26T02:24:06.068 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032194+0000", 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032194+0000", 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032195+0000", 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3599999999999999e-06 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032202+0000", 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6479999999999997e-06 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.070 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032232+0000", 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0774e-05 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032245+0000", 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2795e-05 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032329+0000", 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4215000000000006e-05 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032357+0000", 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7351e-05 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=44, last_complete=37'19, committed=1, applied=1))", 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.032942+0000", 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.029299237, 2024-04-26T02:24:06.072 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016247500000000001, 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032942+0000", 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032942+0000", 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032944+0000", 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0229999999999999e-06 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032956+0000", 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2493e-05 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032989+0000", 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2978999999999997e-05 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.033004+0000", 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4246e-05 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.033084+0000", 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0482000000000006e-05 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.033104+0000", 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0251999999999999e-05 2024-04-26T02:24:06.075 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 36/31 ECSubWriteReply(tid=43, last_complete=37'17, committed=1, applied=1))", 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.035085+0000", 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0271563889999999, 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000240812, 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035085+0000", 2024-04-26T02:24:06.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035085+0000", 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035086+0000", 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1069999999999999e-06 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035093+0000", 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0820000000000001e-06 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035110+0000", 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7439e-05 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035121+0000", 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1058e-05 2024-04-26T02:24:06.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035269+0000", 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000147558 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035326+0000", 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6567999999999998e-05 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.079 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=44, last_complete=37'19, committed=1, applied=1))", 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.035103+0000", 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0271380139999999, 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000289552, 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035103+0000", 2024-04-26T02:24:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035103+0000", 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035104+0000", 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5600000000000004e-07 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035110+0000", 2024-04-26T02:24:06.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0059999999999998e-06 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035125+0000", 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4863e-05 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035135+0000", 2024-04-26T02:24:06.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0104e-05 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035363+0000", 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000228159 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.084 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.035393+0000", 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9464000000000001e-05 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=44, last_complete=37'19, committed=1, applied=1))", 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.037924+0000", 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0243171680000001, 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000500323, 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.085 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037924+0000", 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037924+0000", 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037925+0000", 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1170000000000001e-06 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037934+0000", 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6880000000000005e-06 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037978+0000", 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4051999999999998e-05 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037989+0000", 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1177e-05 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038414+0000", 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000425043 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038424+0000", 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0246e-05 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=43, last_complete=37'17, committed=1, applied=1))", 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.037935+0000", 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0243065600000001, 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00046230099999999998, 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037935+0000", 2024-04-26T02:24:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037935+0000", 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037936+0000", 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1930000000000001e-06 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037943+0000", 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9110000000000004e-06 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037970+0000", 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7302000000000001e-05 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.037981+0000", 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1508999999999999e-05 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038319+0000", 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000337268 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038397+0000", 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8118e-05 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=44, last_complete=37'19, committed=1, applied=1))", 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.038011+0000", 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.02423022, 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010214480000000001, 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038011+0000", 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038011+0000", 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038011+0000", 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.06e-07 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038016+0000", 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3150000000000002e-06 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038028+0000", 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1768e-05 2024-04-26T02:24:06.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038036+0000", 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3790000000000006e-06 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.038442+0000", 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000405824 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039032+0000", 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00059065599999999995 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0227090830000001, 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043860330000000001, 2024-04-26T02:24:06.100 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2300000000000002e-07 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039557+0000", 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4723999999999999e-05 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039573+0000", 2024-04-26T02:24:06.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5540999999999999e-05 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039584+0000", 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1505000000000001e-05 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039717+0000", 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013328799999999999 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039746+0000", 2024-04-26T02:24:06.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8279000000000001e-05 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043829+0000", 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040835460000000004 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043918+0000", 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8826999999999995e-05 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0216077809999999, 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070939660000000002, 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040634+0000", 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1800000000000005e-07 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040658+0000", 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3377999999999999e-05 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040673+0000", 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5376999999999999e-05 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040683+0000", 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0446e-05 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040733+0000", 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0002e-05 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040740+0000", 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2210000000000002e-06 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047581+0000", 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068417319999999997 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047727+0000", 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014599200000000001 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=45, last_complete=37'19, committed=1, applied=1))", 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.042661+0000", 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.019580634, 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018464999999999999, 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.109 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042661+0000", 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042661+0000", 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042662+0000", 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.099e-06 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042668+0000", 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7009999999999999e-06 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042684+0000", 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.573e-05 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042695+0000", 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0730000000000001e-05 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042819+0000", 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012390200000000001 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.042845+0000", 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6488000000000001e-05 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=45, last_complete=37'19, committed=1, applied=1))", 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.043288+0000", 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.018953389, 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014503199999999999, 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043288+0000", 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043288+0000", 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043289+0000", 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.497e-06 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043298+0000", 2024-04-26T02:24:06.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6160000000000002e-06 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043326+0000", 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7789000000000001e-05 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043345+0000", 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.946e-05 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043421+0000", 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6186999999999994e-05 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043433+0000", 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1483e-05 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.as0 37/31 ECSubWriteReply(tid=45, last_complete=37'19, committed=1, applied=1))", 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.047184+0000", 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.015057205, 2024-04-26T02:24:06.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000225577, 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047184+0000", 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047184+0000", 2024-04-26T02:24:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047185+0000", 2024-04-26T02:24:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0610000000000001e-06 2024-04-26T02:24:06.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047192+0000", 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6309999999999997e-06 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047219+0000", 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7284000000000002e-05 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047230+0000", 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0803e-05 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047331+0000", 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101289 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047410+0000", 2024-04-26T02:24:06.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8509000000000003e-05 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 37/31 ECSubWrite(tid=13, reqid=osd.15.0:13, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0147780719999999, 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023542559999999999, 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.121 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5699999999999998e-07 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047493+0000", 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9451e-05 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047509+0000", 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5984000000000001e-05 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047520+0000", 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1245e-05 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047677+0000", 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015684499999999999 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047700+0000", 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3376000000000001e-05 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.049768+0000", 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020678770000000001 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.049817+0000", 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9120999999999999e-05 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=65, reqid=osd.0.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:06.125 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.056126+0000", 2024-04-26T02:24:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.006114961, 2024-04-26T02:24:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024618159999999999, 2024-04-26T02:24:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056126+0000", 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056126+0000", 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056129+0000", 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3499999999999999e-06 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056159+0000", 2024-04-26T02:24:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0039000000000002e-05 2024-04-26T02:24:06.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056194+0000", 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5296000000000002e-05 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056238+0000", 2024-04-26T02:24:06.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3671000000000003e-05 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056339+0000", 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101452 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056348+0000", 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6039999999999993e-06 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058533+0000", 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002185541 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058588+0000", 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4863e-05 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 37/31 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.056158+0000", 2024-04-26T02:24:06.131 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.0060832820000001, 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023927570000000001, 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056158+0000", 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056158+0000", 2024-04-26T02:24:06.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056159+0000", 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.178e-06 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056172+0000", 2024-04-26T02:24:06.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2653999999999999e-05 2024-04-26T02:24:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056192+0000", 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0469999999999999e-05 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056204+0000", 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1418e-05 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056322+0000", 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011858600000000001 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056333+0000", 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1046000000000001e-05 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058503+0000", 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021693319999999999 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058551+0000", 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8072999999999999e-05 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.137 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:201 3.ds0 3:bba78641:::smithi17529564-30:head [stat,delete] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.99763477899999997, 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006036591, 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:06.138 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 201 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064608+0000", 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.826e-06 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064617+0000", 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8799999999999997e-06 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064634+0000", 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6495999999999999e-05 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064641+0000", 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8520000000000004e-06 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064728+0000", 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6112999999999994e-05 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064856+0000", 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000128734 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065756+0000", 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089999800000000005 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067196+0000", 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014399969999999999 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070552+0000", 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033559589999999999 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.142 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070643+0000", 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0736000000000007e-05 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 37/31 ECSubWriteReply(tid=46, last_complete=37'12, committed=1, applied=1))", 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.070439+0000", 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.99180184800000004, 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00055987799999999998, 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.143 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070439+0000", 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070439+0000", 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070440+0000", 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7899999999999998e-07 2024-04-26T02:24:06.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070445+0000", 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5379999999999996e-06 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070455+0000", 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0166000000000001e-05 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070462+0000", 2024-04-26T02:24:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2729999999999997e-06 2024-04-26T02:24:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070503+0000", 2024-04-26T02:24:06.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0605999999999997e-05 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070999+0000", 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00049661599999999996 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 37/31 ECSubWriteReply(tid=47, last_complete=37'12, committed=1, applied=1))", 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.072186+0000", 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.99005513099999998, 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014222900000000001, 2024-04-26T02:24:06.147 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072186+0000", 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072186+0000", 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.148 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072187+0000", 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8100000000000002e-07 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072191+0000", 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.69e-06 2024-04-26T02:24:06.149 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072207+0000", 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5645e-05 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.150 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072215+0000", 2024-04-26T02:24:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.422e-06 2024-04-26T02:24:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072309+0000", 2024-04-26T02:24:06.151 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3226000000000005e-05 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072328+0000", 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9565e-05 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 37/31 ECSubWriteReply(tid=47, last_complete=37'12, committed=1, applied=1))", 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.072326+0000", 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.98991547400000002, 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018163000000000001, 2024-04-26T02:24:06.152 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:06.154 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072326+0000", 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072326+0000", 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072326+0000", 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2399999999999998e-07 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.155 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072330+0000", 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6739999999999999e-06 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072338+0000", 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0909999999999993e-06 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072345+0000", 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6209999999999998e-06 2024-04-26T02:24:06.156 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072488+0000", 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014306900000000001 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072507+0000", 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9650999999999999e-05 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:06.157 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:06.158 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:06.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:24:06.161 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:06.159+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:06.260 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:06.256+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:06.292 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:06.292 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:06.292 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:06.292 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:06.306 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:24:06.361 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:06.359+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:06.428 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:06.428 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:06.428 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:06.428 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:06.428 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:06.442 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:24:06.487 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:06.484+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 37/31 ECSubWrite(tid=43, reqid=osd.12.0:43, at_version=37'17, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.028677+0000", 2024-04-26T02:24:06.563 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.530914855, 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068193439999999998, 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028677+0000", 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028677+0000", 2024-04-26T02:24:06.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028678+0000", 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4700000000000001e-07 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028733+0000", 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5498999999999998e-05 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.565 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028759+0000", 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5503e-05 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028781+0000", 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2317e-05 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028944+0000", 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016298800000000001 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028969+0000", 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5170000000000001e-05 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035396+0000", 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006427098 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035496+0000", 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100122 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 37/31 ECSubWrite(tid=44, reqid=osd.12.0:44, at_version=37'19, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.029993+0000", 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.529598628, 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006125419, 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.029993+0000", 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.029993+0000", 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.029995+0000", 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9039999999999999e-06 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030086+0000", 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0934999999999996e-05 2024-04-26T02:24:06.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030127+0000", 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1103000000000003e-05 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030151+0000", 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3672999999999998e-05 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.031117+0000", 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00096582799999999996 2024-04-26T02:24:06.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.031142+0000", 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5761999999999998e-05 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036049+0000", 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049064879999999996 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036119+0000", 2024-04-26T02:24:06.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9726000000000003e-05 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.035501+0000", 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.524090495, 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0081818700000000008, 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035501+0000", 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035501+0000", 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035502+0000", 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6000000000000002e-07 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035579+0000", 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6536e-05 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035609+0000", 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0173000000000001e-05 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035628+0000", 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9525999999999999e-05 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035780+0000", 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015120500000000001 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035804+0000", 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4043e-05 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043585+0000", 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077808879999999997 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.575 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043683+0000", 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8639000000000002e-05 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 37/31 ECSubWrite(tid=45, reqid=osd.12.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.038059+0000", 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.521533241, 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056000429999999999, 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.576 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038059+0000", 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038059+0000", 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038060+0000", 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.88e-06 2024-04-26T02:24:06.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038090+0000", 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9133e-05 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038119+0000", 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.906e-05 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038139+0000", 2024-04-26T02:24:06.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0496000000000002e-05 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038292+0000", 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000153282 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038318+0000", 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5113000000000002e-05 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043580+0000", 2024-04-26T02:24:06.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052621300000000003 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043659+0000", 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8949000000000006e-05 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.038696+0000", 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.520896099, 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006334587, 2024-04-26T02:24:06.580 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038696+0000", 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038696+0000", 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.581 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038697+0000", 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0240000000000001e-06 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038753+0000", 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6585000000000001e-05 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038778+0000", 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4519999999999999e-05 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038800+0000", 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2569999999999999e-05 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039007+0000", 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020635400000000001 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039031+0000", 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4303000000000001e-05 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.583 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.044951+0000", 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.005920135 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045030+0000", 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9096000000000003e-05 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039673+0000", 2024-04-26T02:24:06.584 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.5199190809999998, 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0076317160000000002, 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039673+0000", 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039673+0000", 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039675+0000", 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.756e-06 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039718+0000", 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3633000000000001e-05 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039738+0000", 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.969e-05 2024-04-26T02:24:06.586 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039751+0000", 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.344e-05 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041214+0000", 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001462638 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041238+0000", 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3617000000000001e-05 2024-04-26T02:24:06.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047207+0000", 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059689740000000002 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047304+0000", 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7967999999999994e-05 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 37/31 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.042301+0000", 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.5172907310000001, 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049154209999999997, 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042301+0000", 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042301+0000", 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042303+0000", 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7460000000000001e-06 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042355+0000", 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2447000000000001e-05 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042397+0000", 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1428999999999999e-05 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042417+0000", 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9933e-05 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042886+0000", 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00046904800000000001 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042908+0000", 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1929999999999998e-05 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047120+0000", 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0042126990000000003 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047217+0000", 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6188999999999997e-05 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.592 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/31 ECSubWrite(tid=13, reqid=osd.15.0:13, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.047444+0000", 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.5121478860000002, 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0033794329999999998, 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047444+0000", 2024-04-26T02:24:06.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047444+0000", 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047445+0000", 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7300000000000005e-07 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.594 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047497+0000", 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2636000000000002e-05 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047526+0000", 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8422999999999999e-05 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047546+0000", 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0653e-05 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047733+0000", 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000186374 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047764+0000", 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1476999999999997e-05 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050741+0000", 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029770949999999999 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050823+0000", 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2002000000000005e-05 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 37/31 ECSubWrite(tid=179, reqid=osd.6.0:178, at_version=0'0, trim_to=0'0, roll_forward_to=37'15))", 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.049428+0000", 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.510163425, 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0033214239999999999, 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.597 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049428+0000", 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049428+0000", 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.598 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049431+0000", 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4530000000000001e-06 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049459+0000", 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8405999999999999e-05 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049490+0000", 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0527000000000001e-05 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049510+0000", 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9828999999999999e-05 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049665+0000", 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015490100000000001 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049690+0000", 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5137e-05 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.600 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052636+0000", 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029463800000000002 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052750+0000", 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000113791 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 37/31 ECSubWrite(tid=65, reqid=osd.0.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.054906+0000", 2024-04-26T02:24:06.601 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.504685641, 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0042048090000000003, 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054906+0000", 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054906+0000", 2024-04-26T02:24:06.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054908+0000", 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.81e-06 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054941+0000", 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2700000000000002e-05 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054971+0000", 2024-04-26T02:24:06.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0474999999999999e-05 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054990+0000", 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9094e-05 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055134+0000", 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014328799999999999 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055158+0000", 2024-04-26T02:24:06.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4813000000000001e-05 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.058985+0000", 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038262109999999999 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.059111+0000", 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012641799999999999 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.605 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/31 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.056721+0000", 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.502870908, 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048381149999999996, 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056721+0000", 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.606 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056721+0000", 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056722+0000", 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8400000000000003e-07 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056744+0000", 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2523000000000001e-05 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056769+0000", 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4802000000000001e-05 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056789+0000", 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0434000000000001e-05 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057116+0000", 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032685199999999998 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057140+0000", 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.387e-05 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.061478+0000", 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043380709999999998 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.061559+0000", 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0778999999999993e-05 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 38/31 ECSubWrite(tid=66, reqid=osd.0.0:66, at_version=38'31, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.038643+0000", 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.52094923699999995, 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0064538010000000003, 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.610 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038643+0000", 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038643+0000", 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038644+0000", 2024-04-26T02:24:06.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0359999999999999e-06 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038695+0000", 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1143000000000001e-05 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038721+0000", 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6556000000000001e-05 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038744+0000", 2024-04-26T02:24:06.612 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3e-05 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039276+0000", 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00053199200000000001 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039300+0000", 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3427000000000001e-05 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045019+0000", 2024-04-26T02:24:06.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057195709999999997 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045096+0000", 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7076000000000005e-05 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.039350+0000", 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.52024213100000005, 2024-04-26T02:24:06.614 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073940389999999998, 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039350+0000", 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039350+0000", 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.615 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039351+0000", 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.66e-06 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039409+0000", 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7256000000000002e-05 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039472+0000", 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2948999999999996e-05 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.616 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039493+0000", 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1849999999999999e-05 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040117+0000", 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00062314200000000003 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040142+0000", 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5236e-05 2024-04-26T02:24:06.617 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046665+0000", 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065227169999999999 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046744+0000", 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9228999999999996e-05 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.51909507700000002, 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063562699999999998, 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.619 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4000000000000001e-07 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040551+0000", 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3547000000000001e-05 2024-04-26T02:24:06.620 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040582+0000", 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0998999999999999e-05 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040601+0000", 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8957000000000002e-05 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040767+0000", 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016631400000000001 2024-04-26T02:24:06.621 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040793+0000", 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5863e-05 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046775+0000", 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059822640000000002 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046853+0000", 2024-04-26T02:24:06.622 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7686000000000001e-05 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.040709+0000", 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.51888308299999997, 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059600859999999999, 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.623 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040709+0000", 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040709+0000", 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040710+0000", 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7999999999999993e-07 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.624 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040752+0000", 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1763e-05 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040777+0000", 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5173000000000001e-05 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040795+0000", 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8346e-05 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.625 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040939+0000", 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000144122 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040954+0000", 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4800000000000001e-05 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046569+0000", 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056153560000000002 2024-04-26T02:24:06.626 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046669+0000", 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9545999999999999e-05 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.6s6 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.043883+0000", 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.51570885300000002, 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065081770000000004, 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.627 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043883+0000", 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043883+0000", 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.628 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043885+0000", 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.733e-06 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043910+0000", 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5616e-05 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043933+0000", 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2396999999999999e-05 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.629 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043947+0000", 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4357e-05 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044094+0000", 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000146864 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044118+0000", 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4012999999999999e-05 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.630 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050296+0000", 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061779319999999997 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050391+0000", 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5265000000000004e-05 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 38/31 ECSubWrite(tid=180, reqid=osd.6.0:180, at_version=38'17, trim_to=0'0, roll_forward_to=37'15))", 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.045946+0000", 2024-04-26T02:24:06.631 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.513645558, 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057735540000000002, 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045946+0000", 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045946+0000", 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045947+0000", 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0299999999999999e-07 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045994+0000", 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7443e-05 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046026+0000", 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1242999999999999e-05 2024-04-26T02:24:06.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046078+0000", 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2246000000000001e-05 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046295+0000", 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021728399999999999 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046320+0000", 2024-04-26T02:24:06.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4986000000000001e-05 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051622+0000", 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0053014000000000004 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051720+0000", 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8349000000000003e-05 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.057748+0000", 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.50184340999999999, 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072443610000000004, 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057748+0000", 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.636 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057748+0000", 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057751+0000", 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.17e-06 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057779+0000", 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8552999999999999e-05 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057815+0000", 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5892999999999997e-05 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057842+0000", 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6883e-05 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057997+0000", 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015542799999999999 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058022+0000", 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4392999999999998e-05 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064892+0000", 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068701789999999997 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064993+0000", 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100862 2024-04-26T02:24:06.639 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 38/31 ECSubWrite(tid=69, reqid=osd.0.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.057769+0000", 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.50182333400000001, 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075345739999999996, 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057769+0000", 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057769+0000", 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057770+0000", 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057792+0000", 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.243e-05 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057816+0000", 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3963000000000001e-05 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057840+0000", 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4260000000000002e-05 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.642 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057995+0000", 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015475800000000001 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058020+0000", 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4756000000000002e-05 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065172+0000", 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071519890000000001 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065303+0000", 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013120800000000001 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.058837+0000", 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 0.50075481200000005, 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065676170000000004, 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:06.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058837+0000", 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058837+0000", 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058838+0000", 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.147e-06 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058900+0000", 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1902000000000005e-05 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058931+0000", 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.116e-05 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058966+0000", 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4452999999999997e-05 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059116+0000", 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015071099999999999 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059141+0000", 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4736000000000002e-05 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065330+0000", 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061886019999999996 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:06.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065405+0000", 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.4906000000000004e-05 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:06.648 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:06.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:06.650 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:24:06.651 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:06.644+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:06.680 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:06.680 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:06.680 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-04-26T02:24:06.680 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-04-26T02:24:06.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:06.750 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:06.744+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:06.809 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:06.824 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:06.825 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:06.825 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:06.825 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:06.832 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:06.832 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:06.839 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:24:06.868 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:06.868 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:06.883 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:06.880+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:06.904 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:06.904 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:06.921 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:06.922 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:06.942 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:06.942 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:06.953 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:06.950+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:06.962 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:06.962 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:06.963 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:06.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:24:06.983 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:06.983 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:07.000 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:07.001 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:07.019 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:07.020 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:07.029 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:07.029 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:07.042 INFO:tasks.rados.rados.0.smithi175.stdout:75: done (1 left) 2024-04-26T02:24:07.042 INFO:tasks.rados.rados.0.smithi175.stdout:76: done (0 left) 2024-04-26T02:24:07.042 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 45 current snap is 3 2024-04-26T02:24:07.042 INFO:tasks.rados.rados.0.smithi175.stdout:77: seq_num 59 ranges {753664=622592,1376256=376832} 2024-04-26T02:24:07.044 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:07.044 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:07.051 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-26T02:24:06.714089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":13632032,"num_objects":32,"num_object_clones":1,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":194,"num_read_kb":147,"num_write":264,"num_write_kb":16196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":455456,"kb_used_data":23080,"kb_used_omap":24,"kb_used_meta":432103,"kb_avail":1509493984,"statfs":{"total":1546188226560,"available":1545721839616,"internally_reserved":0,"allocated":23633920,"data_stored":21205385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":442473555},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13041664,"num_objects":30,"num_object_clones":1,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":58,"num_read_kb":29,"num_write":61,"num_write_kb":12736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001072"},"pg_stats":[{"pgid":"3.f","version":"34'8","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.096415+0000","last_change":"2024-04-26T02:24:00.376280+0000","last_active":"2024-04-26T02:24:03.096415+0000","last_peered":"2024-04-26T02:24:03.096415+0000","last_clean":"2024-04-26T02:24:03.096415+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:03.096415+0000","last_undegraded":"2024-04-26T02:24:03.096415+0000","last_fullsized":"2024-04-26T02:24:03.096415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.585657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2080768,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":8,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.041596+0000","last_change":"2024-04-26T02:24:00.147159+0000","last_active":"2024-04-26T02:24:01.041596+0000","last_peered":"2024-04-26T02:24:01.041596+0000","last_clean":"2024-04-26T02:24:01.041596+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:01.041596+0000","last_undegraded":"2024-04-26T02:24:01.041596+0000","last_fullsized":"2024-04-26T02:24:01.041596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.316004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.d","version":"34'10","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.013656+0000","last_change":"2024-04-26T02:24:00.152415+0000","last_active":"2024-04-26T02:24:03.013656+0000","last_peered":"2024-04-26T02:24:03.013656+0000","last_clean":"2024-04-26T02:24:03.013656+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:03.013656+0000","last_undegraded":"2024-04-26T02:24:03.013656+0000","last_fullsized":"2024-04-26T02:24:03.013656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:28.521009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244608,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":10,"num_write_kb":2192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"3.c","version":"34'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.096269+0000","last_change":"2024-04-26T02:24:00.147467+0000","last_active":"2024-04-26T02:24:03.096269+0000","last_peered":"2024-04-26T02:24:03.096269+0000","last_clean":"2024-04-26T02:24:03.096269+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:03.096269+0000","last_undegraded":"2024-04-26T02:24:03.096269+0000","last_fullsized":"2024-04-26T02:24:03.096269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:21.129987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4243456,"num_objects":8,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":8,"num_write":17,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.041692+0000","last_change":"2024-04-26T02:24:00.092303+0000","last_active":"2024-04-26T02:24:01.041692+0000","last_peered":"2024-04-26T02:24:01.041692+0000","last_clean":"2024-04-26T02:24:01.041692+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:01.041692+0000","last_undegraded":"2024-04-26T02:24:01.041692+0000","last_fullsized":"2024-04-26T02:24:01.041692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:18.881208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.026527+0000","last_change":"2024-04-26T02:24:00.090465+0000","last_active":"2024-04-26T02:24:03.026527+0000","last_peered":"2024-04-26T02:24:03.026527+0000","last_clean":"2024-04-26T02:24:03.026527+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:03.026527+0000","last_undegraded":"2024-04-26T02:24:03.026527+0000","last_fullsized":"2024-04-26T02:24:03.026527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.865824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966656,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":8,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.041378+0000","last_change":"2024-04-26T02:24:00.308710+0000","last_active":"2024-04-26T02:24:01.041378+0000","last_peered":"2024-04-26T02:24:01.041378+0000","last_clean":"2024-04-26T02:24:01.041378+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:01.041378+0000","last_undegraded":"2024-04-26T02:24:01.041378+0000","last_fullsized":"2024-04-26T02:24:01.041378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.506015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.039409+0000","last_change":"2024-04-26T02:24:00.371322+0000","last_active":"2024-04-26T02:24:01.039409+0000","last_peered":"2024-04-26T02:24:01.039409+0000","last_clean":"2024-04-26T02:24:01.039409+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:01.039409+0000","last_undegraded":"2024-04-26T02:24:01.039409+0000","last_fullsized":"2024-04-26T02:24:01.039409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.748042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"26'157","reported_seq":223,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.039190+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:01.039190+0000","last_peered":"2024-04-26T02:24:01.039190+0000","last_clean":"2024-04-26T02:24:01.039190+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:01.039190+0000","last_undegraded":"2024-04-26T02:24:01.039190+0000","last_fullsized":"2024-04-26T02:24:01.039190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:00.992521+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:00.992521+0000","last_peered":"2024-04-26T02:24:00.992521+0000","last_clean":"2024-04-26T02:24:00.992521+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:00.992521+0000","last_undegraded":"2024-04-26T02:24:00.992521+0000","last_fullsized":"2024-04-26T02:24:00.992521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:00.992425+0000","last_change":"2024-04-26T02:24:00.373596+0000","last_active":"2024-04-26T02:24:00.992425+0000","last_peered":"2024-04-26T02:24:00.992425+0000","last_clean":"2024-04-26T02:24:00.992425+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:00.992425+0000","last_undegraded":"2024-04-26T02:24:00.992425+0000","last_fullsized":"2024-04-26T02:24:00.992425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.419870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.018659+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:03.018659+0000","last_peered":"2024-04-26T02:24:03.018659+0000","last_clean":"2024-04-26T02:24:03.018659+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:03.018659+0000","last_undegraded":"2024-04-26T02:24:03.018659+0000","last_fullsized":"2024-04-26T02:24:03.018659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"34'6","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T02:24:05.054801+0000","last_change":"2024-04-26T02:24:05.055637+0000","last_active":"2024-04-26T02:24:05.054801+0000","last_peered":"2024-04-26T02:24:05.054801+0000","last_clean":"2024-04-26T02:24:05.054801+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:05.054801+0000","last_undegraded":"2024-04-26T02:24:05.054801+0000","last_fullsized":"2024-04-26T02:24:05.054801+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.246871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001529063,"stat_sum":{"num_bytes":655360,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":6,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:00.992349+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:00.992349+0000","last_peered":"2024-04-26T02:24:00.992349+0000","last_clean":"2024-04-26T02:24:00.992349+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:00.992349+0000","last_undegraded":"2024-04-26T02:24:00.992349+0000","last_fullsized":"2024-04-26T02:24:00.992349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.040505+0000","last_change":"2024-04-26T02:24:00.308537+0000","last_active":"2024-04-26T02:24:01.040505+0000","last_peered":"2024-04-26T02:24:01.040505+0000","last_clean":"2024-04-26T02:24:01.040505+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:01.040505+0000","last_undegraded":"2024-04-26T02:24:01.040505+0000","last_fullsized":"2024-04-26T02:24:01.040505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.545143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.019181+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:03.019181+0000","last_peered":"2024-04-26T02:24:03.019181+0000","last_clean":"2024-04-26T02:24:03.019181+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:03.019181+0000","last_undegraded":"2024-04-26T02:24:03.019181+0000","last_fullsized":"2024-04-26T02:24:03.019181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T02:24:05.032927+0000","last_change":"2024-04-26T02:24:05.034005+0000","last_active":"2024-04-26T02:24:05.032927+0000","last_peered":"2024-04-26T02:24:05.032927+0000","last_clean":"2024-04-26T02:24:05.032927+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:05.032927+0000","last_undegraded":"2024-04-26T02:24:05.032927+0000","last_fullsized":"2024-04-26T02:24:05.032927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:26.182793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001763929,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.5","version":"34'8","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.019217+0000","last_change":"2024-04-26T02:24:00.374326+0000","last_active":"2024-04-26T02:24:03.019217+0000","last_peered":"2024-04-26T02:24:03.019217+0000","last_clean":"2024-04-26T02:24:03.019217+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:03.019217+0000","last_undegraded":"2024-04-26T02:24:03.019217+0000","last_fullsized":"2024-04-26T02:24:03.019217+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:22.772038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2080768,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":8,"num_write_kb":2032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-26T02:24:05.054414+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:05.054414+0000","last_peered":"2024-04-26T02:24:05.054414+0000","last_clean":"2024-04-26T02:24:05.054414+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:05.054414+0000","last_undegraded":"2024-04-26T02:24:05.054414+0000","last_fullsized":"2024-04-26T02:24:05.054414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.042099+0000","last_change":"2024-04-26T02:24:00.377031+0000","last_active":"2024-04-26T02:24:01.042099+0000","last_peered":"2024-04-26T02:24:01.042099+0000","last_clean":"2024-04-26T02:24:01.042099+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:01.042099+0000","last_undegraded":"2024-04-26T02:24:01.042099+0000","last_fullsized":"2024-04-26T02:24:01.042099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:24.655193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:00.990602+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:00.990602+0000","last_peered":"2024-04-26T02:24:00.990602+0000","last_clean":"2024-04-26T02:24:00.990602+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:00.990602+0000","last_undegraded":"2024-04-26T02:24:00.990602+0000","last_fullsized":"2024-04-26T02:24:00.990602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T02:24:04.043208+0000","last_change":"2024-04-26T02:24:00.011151+0000","last_active":"2024-04-26T02:24:04.043208+0000","last_peered":"2024-04-26T02:24:04.043208+0000","last_clean":"2024-04-26T02:24:04.043208+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:04.043208+0000","last_undegraded":"2024-04-26T02:24:04.043208+0000","last_fullsized":"2024-04-26T02:24:04.043208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:17.687041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":770048,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.165753+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:01.165753+0000","last_peered":"2024-04-26T02:24:01.165753+0000","last_clean":"2024-04-26T02:24:01.165753+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:01.165753+0000","last_undegraded":"2024-04-26T02:24:01.165753+0000","last_fullsized":"2024-04-26T02:24:01.165753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-26T02:24:01.165927+0000","last_change":"2024-04-26T02:24:00.308717+0000","last_active":"2024-04-26T02:24:01.165927+0000","last_peered":"2024-04-26T02:24:01.165927+0000","last_clean":"2024-04-26T02:24:01.165927+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:01.165927+0000","last_undegraded":"2024-04-26T02:24:01.165927+0000","last_fullsized":"2024-04-26T02:24:01.165927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.535632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-04-26T02:24:03.018766+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:03.018766+0000","last_peered":"2024-04-26T02:24:03.018766+0000","last_clean":"2024-04-26T02:24:03.018766+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:03.018766+0000","last_undegraded":"2024-04-26T02:24:03.018766+0000","last_fullsized":"2024-04-26T02:24:03.018766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":13041664,"num_objects":30,"num_object_clones":1,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":58,"num_read_kb":29,"num_write":61,"num_write_kb":12736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16392192,"data_stored":17342464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215113,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29728,"kb_used_data":2704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342112,"statfs":{"total":96636764160,"available":96606322688,"internally_reserved":0,"allocated":2768896,"data_stored":2558021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215110,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28880,"kb_used_data":1856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342960,"statfs":{"total":96636764160,"available":96607191040,"internally_reserved":0,"allocated":1900544,"data_stored":1699882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215110,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29544,"kb_used_data":2520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342296,"statfs":{"total":96636764160,"available":96606511104,"internally_reserved":0,"allocated":2580480,"data_stored":2379818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313222,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30864,"kb_used_data":3844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340976,"statfs":{"total":96636764160,"available":96605159424,"internally_reserved":0,"allocated":3936256,"data_stored":4175887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280518,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29680,"kb_used_data":2656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342160,"statfs":{"total":96636764160,"available":96606371840,"internally_reserved":0,"allocated":2719744,"data_stored":2740296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280519,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1355776,"data_stored":1314888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280519,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":168032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280517,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":157819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280519,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":157819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280517,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":356352,"data_stored":157819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":888832,"data_stored":686747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280518,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":905216,"data_stored":696960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280517,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":168032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280518,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":168032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280518,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":372736,"data_stored":168032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[3,5,6,7,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215110,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30948,"kb_used_data":3924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340892,"statfs":{"total":96636764160,"available":96605073408,"internally_reserved":0,"allocated":4018176,"data_stored":3807301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3629056,"data_stored":3629056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3514368,"data_stored":3977216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":2191360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":1495040,"data_stored":1511424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2281472,"data_stored":2531328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":917504,"data_stored":1105920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":2379776,"data_stored":2396160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:07.053 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-04-26T02:24:07.063 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:07.060+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:07.064 INFO:tasks.rados.rados.0.smithi175.stdout:77: writing smithi17529564-45 from 753664 to 1376256 tid 1 2024-04-26T02:24:07.065 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:07.066 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:07.070 INFO:tasks.rados.rados.0.smithi175.stdout:77: writing smithi17529564-45 from 1376256 to 1753088 tid 2 2024-04-26T02:24:07.071 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 7 current snap is 3 2024-04-26T02:24:07.071 INFO:tasks.rados.rados.0.smithi175.stdout:78: seq_num 60 ranges {114688=638976,753664=376832} 2024-04-26T02:24:07.084 INFO:tasks.rados.rados.0.smithi175.stdout:78: writing smithi17529564-7 from 114688 to 753664 tid 1 2024-04-26T02:24:07.085 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:07.085 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:07.090 INFO:tasks.rados.rados.0.smithi175.stdout:78: writing smithi17529564-7 from 753664 to 1130496 tid 2 2024-04-26T02:24:07.090 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 37 current snap is 3 2024-04-26T02:24:07.090 INFO:tasks.rados.rados.0.smithi175.stdout:79: seq_num 61 ranges {606208=655360,1261568=376832} 2024-04-26T02:24:07.105 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:07.105 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:07.107 INFO:tasks.rados.rados.0.smithi175.stdout:79: writing smithi17529564-37 from 606208 to 1261568 tid 1 2024-04-26T02:24:07.111 INFO:tasks.rados.rados.0.smithi175.stdout:79: writing smithi17529564-37 from 1261568 to 1638400 tid 2 2024-04-26T02:24:07.111 INFO:tasks.rados.rados.0.smithi175.stdout:80: snap_remove snap 2 2024-04-26T02:24:07.129 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:07.129 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:07.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:07.124+0000 7f41994e0640 0 -- 172.21.15.59:0/873227800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f419415b810 msgr2=0x7f4194145080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:07.151 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:07.151 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:07.151 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:07.155 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:07.148+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:07.165 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:24:07.256 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:07.254+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:07.327 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:07.327 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:07.341 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:24:07.357 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:07.352+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:07.458 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:07.452+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:07.464 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:07.465 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:07.479 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:24:07.559 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:07.556+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:07.649 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:07.650 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:07.661 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:07.656+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:07.664 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:24:07.761 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:07.756+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:07.781 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:07.781 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:07.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:24:07.863 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:07.862+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:07.919 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:07.919 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:07.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:07.979 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:07.976+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:08.056 INFO:tasks.rados.rados.0.smithi175.stdout:80: done (3 left) 2024-04-26T02:24:08.056 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 30 current snap is 3 2024-04-26T02:24:08.056 INFO:tasks.rados.rados.0.smithi175.stdout:77: finishing write tid 1 to smithi17529564-45 2024-04-26T02:24:08.056 INFO:tasks.rados.rados.0.smithi175.stdout:77: finishing write tid 2 to smithi17529564-45 2024-04-26T02:24:08.056 INFO:tasks.rados.rados.0.smithi175.stdout:77: finishing write tid 3 to smithi17529564-45 2024-04-26T02:24:08.056 INFO:tasks.rados.rados.0.smithi175.stdout:77: finishing write tid 4 to smithi17529564-45 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:77: oid 45 updating version 0 to 16 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:77: oid 45 updating version 16 to 18 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:77: oid 45 version 18 is already newer than 17 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 45 v 18 (ObjNum 59 snap 3 seq_num 59) dirty exists 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:77: left oid 45 (ObjNum 59 snap 3 seq_num 59) 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: finishing write tid 1 to smithi17529564-7 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: finishing write tid 2 to smithi17529564-7 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: finishing write tid 3 to smithi17529564-7 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: finishing write tid 4 to smithi17529564-7 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: oid 7 updating version 0 to 9 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: oid 7 updating version 9 to 10 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: oid 7 updating version 10 to 11 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 7 v 11 (ObjNum 60 snap 3 seq_num 60) dirty exists 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:78: left oid 7 (ObjNum 60 snap 3 seq_num 60) 2024-04-26T02:24:08.057 INFO:tasks.rados.rados.0.smithi175.stdout:79: finishing write tid 1 to smithi17529564-37 2024-04-26T02:24:08.058 INFO:tasks.rados.rados.0.smithi175.stdout:79: finishing write tid 2 to smithi17529564-37 2024-04-26T02:24:08.058 INFO:tasks.rados.rados.0.smithi175.stdout:81: seq_num 62 ranges {0=671744,671744=376832} 2024-04-26T02:24:08.062 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:08.062 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:08.064 INFO:tasks.rados.rados.0.smithi175.stdout:81: writing smithi17529564-30 from 0 to 671744 tid 1 2024-04-26T02:24:08.065 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:08.060+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:08.069 INFO:tasks.rados.rados.0.smithi175.stdout:81: writing smithi17529564-30 from 671744 to 1048576 tid 2 2024-04-26T02:24:08.069 INFO:tasks.rados.rados.0.smithi175.stdout:77: done (3 left) 2024-04-26T02:24:08.069 INFO:tasks.rados.rados.0.smithi175.stdout:78: done (2 left) 2024-04-26T02:24:08.069 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 14 current snap is 3 2024-04-26T02:24:08.069 INFO:tasks.rados.rados.0.smithi175.stdout:82: seq_num 63 ranges {229376=688128,917504=376832} 2024-04-26T02:24:08.076 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:08.083 INFO:tasks.rados.rados.0.smithi175.stdout:82: writing smithi17529564-14 from 229376 to 917504 tid 1 2024-04-26T02:24:08.089 INFO:tasks.rados.rados.0.smithi175.stdout:82: writing smithi17529564-14 from 917504 to 1294336 tid 2 2024-04-26T02:24:08.089 INFO:tasks.rados.rados.0.smithi175.stdout:79: finishing write tid 3 to smithi17529564-37 2024-04-26T02:24:08.089 INFO:tasks.rados.rados.0.smithi175.stdout:79: finishing write tid 4 to smithi17529564-37 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:79: oid 37 updating version 0 to 16 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:79: oid 37 updating version 16 to 17 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:79: oid 37 updating version 17 to 18 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 37 v 18 (ObjNum 61 snap 3 seq_num 61) dirty exists 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:79: left oid 37 (ObjNum 61 snap 3 seq_num 61) 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:81: finishing write tid 1 to smithi17529564-30 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:81: finishing write tid 2 to smithi17529564-30 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:83: read oid 19 snap -1 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:83: expect (ObjNum 18 snap 0 seq_num 18) 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:79: done (3 left) 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:84: rollback oid 31 current snap is 3 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:84: done (3 left) 2024-04-26T02:24:08.090 INFO:tasks.rados.rados.0.smithi175.stdout:85: delete oid 6 current snap is 3 2024-04-26T02:24:08.092 INFO:tasks.rados.rados.0.smithi175.stdout:81: finishing write tid 3 to smithi17529564-30 2024-04-26T02:24:08.098 INFO:tasks.rados.rados.0.smithi175.stdout:83: expect (ObjNum 18 snap 0 seq_num 18) 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:82: finishing write tid 1 to smithi17529564-14 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:81: finishing write tid 4 to smithi17529564-30 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:81: oid 30 updating version 0 to 19 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:81: oid 30 updating version 19 to 21 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:81: oid 30 version 21 is already newer than 20 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 21 (ObjNum 62 snap 3 seq_num 62) dirty exists 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:81: left oid 30 (ObjNum 62 snap 3 seq_num 62) 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:82: finishing write tid 2 to smithi17529564-14 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:81: done (3 left) 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:83: done (2 left) 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:85: done (1 left) 2024-04-26T02:24:08.136 INFO:tasks.rados.rados.0.smithi175.stdout:86: delete oid 23 current snap is 3 2024-04-26T02:24:08.137 INFO:tasks.rados.rados.0.smithi175.stdout:82: finishing write tid 3 to smithi17529564-14 2024-04-26T02:24:08.137 INFO:tasks.rados.rados.0.smithi175.stdout:82: finishing write tid 4 to smithi17529564-14 2024-04-26T02:24:08.137 INFO:tasks.rados.rados.0.smithi175.stdout:82: oid 14 updating version 0 to 26 2024-04-26T02:24:08.137 INFO:tasks.rados.rados.0.smithi175.stdout:82: oid 14 version 26 is already newer than 25 2024-04-26T02:24:08.137 INFO:tasks.rados.rados.0.smithi175.stdout:82: oid 14 version 26 is already newer than 24 2024-04-26T02:24:08.137 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 14 v 26 (ObjNum 63 snap 3 seq_num 63) dirty exists 2024-04-26T02:24:08.137 INFO:tasks.rados.rados.0.smithi175.stdout:82: left oid 14 (ObjNum 63 snap 3 seq_num 63) 2024-04-26T02:24:08.139 INFO:tasks.rados.rados.0.smithi175.stdout:82: done (1 left) 2024-04-26T02:24:08.139 INFO:tasks.rados.rados.0.smithi175.stdout:86: done (0 left) 2024-04-26T02:24:08.139 INFO:tasks.rados.rados.0.smithi175.stdout:87: read oid 50 snap -1 2024-04-26T02:24:08.139 INFO:tasks.rados.rados.0.smithi175.stdout:87: expect (ObjNum 49 snap 0 seq_num 49) 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:88: rollback oid 47 current snap is 3 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:88: done (1 left) 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:89: rmattr oid 8 current snap is 3 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:89: done (1 left) 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:90: read oid 41 snap -1 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:90: expect (ObjNum 40 snap 0 seq_num 40) 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 45 current snap is 3 2024-04-26T02:24:08.140 INFO:tasks.rados.rados.0.smithi175.stdout:91: seq_num 66 ranges {1753088=737280,2490368=376832} 2024-04-26T02:24:08.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T02:24:08.166 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:08.162+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:08.179 INFO:tasks.rados.rados.0.smithi175.stdout:91: writing smithi17529564-45 from 1753088 to 2490368 tid 1 2024-04-26T02:24:08.184 INFO:tasks.rados.rados.0.smithi175.stdout:91: writing smithi17529564-45 from 2490368 to 2867200 tid 2 2024-04-26T02:24:08.184 INFO:tasks.rados.rados.0.smithi175.stdout:92: copy_from oid 25 from oid 12 current snap is 3 2024-04-26T02:24:08.184 INFO:tasks.rados.rados.0.smithi175.stdout:87: expect (ObjNum 49 snap 0 seq_num 49) 2024-04-26T02:24:08.211 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:08.212 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:08.226 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:08.244 INFO:tasks.rados.rados.0.smithi175.stdout:90: expect (ObjNum 40 snap 0 seq_num 40) 2024-04-26T02:24:08.270 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:08.268+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:08.271 INFO:tasks.rados.rados.0.smithi175.stdout:91: finishing write tid 1 to smithi17529564-45 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:91: finishing write tid 2 to smithi17529564-45 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:91: finishing write tid 3 to smithi17529564-45 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:92: finishing copy_from racing read to smithi17529564-25 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:91: finishing write tid 4 to smithi17529564-45 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:91: oid 45 updating version 0 to 21 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:91: oid 45 updating version 21 to 23 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:91: oid 45 version 23 is already newer than 22 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 45 v 23 (ObjNum 66 snap 3 seq_num 66) dirty exists 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:91: left oid 45 (ObjNum 66 snap 3 seq_num 66) 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:92: finishing copy_from to smithi17529564-25 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 25 v 2 (ObjNum 11 snap 0 seq_num 11) dirty exists 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:87: done (3 left) 2024-04-26T02:24:08.272 INFO:tasks.rados.rados.0.smithi175.stdout:90: done (2 left) 2024-04-26T02:24:08.273 INFO:tasks.rados.rados.0.smithi175.stdout:91: done (1 left) 2024-04-26T02:24:08.273 INFO:tasks.rados.rados.0.smithi175.stdout:92: done (0 left) 2024-04-26T02:24:08.273 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 7 current snap is 3 2024-04-26T02:24:08.273 INFO:tasks.rados.rados.0.smithi175.stdout:93: seq_num 67 ranges {1130496=753664,1884160=376832} 2024-04-26T02:24:08.302 INFO:tasks.rados.rados.0.smithi175.stdout:93: writing smithi17529564-7 from 1130496 to 1884160 tid 1 2024-04-26T02:24:08.308 INFO:tasks.rados.rados.0.smithi175.stdout:93: writing smithi17529564-7 from 1884160 to 2260992 tid 2 2024-04-26T02:24:08.309 INFO:tasks.rados.rados.0.smithi175.stdout:94: snap_create 2024-04-26T02:24:08.311 INFO:tasks.rados.rados.0.smithi175.stdout:93: finishing write tid 1 to smithi17529564-7 2024-04-26T02:24:08.319 INFO:tasks.rados.rados.0.smithi175.stdout:93: finishing write tid 2 to smithi17529564-7 2024-04-26T02:24:08.320 INFO:tasks.rados.rados.0.smithi175.stdout:93: finishing write tid 3 to smithi17529564-7 2024-04-26T02:24:08.323 INFO:tasks.rados.rados.0.smithi175.stdout:93: finishing write tid 4 to smithi17529564-7 2024-04-26T02:24:08.323 INFO:tasks.rados.rados.0.smithi175.stdout:93: oid 7 updating version 0 to 15 2024-04-26T02:24:08.324 INFO:tasks.rados.rados.0.smithi175.stdout:93: oid 7 updating version 15 to 16 2024-04-26T02:24:08.324 INFO:tasks.rados.rados.0.smithi175.stdout:93: oid 7 version 16 is already newer than 14 2024-04-26T02:24:08.324 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 7 v 16 (ObjNum 67 snap 3 seq_num 67) dirty exists 2024-04-26T02:24:08.324 INFO:tasks.rados.rados.0.smithi175.stdout:93: left oid 7 (ObjNum 67 snap 3 seq_num 67) 2024-04-26T02:24:08.351 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:08.352 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:08.366 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:08.367 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:08.364+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:08.468 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:08.464+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:08.535 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:08.535 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:08.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:08.569 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:08.566+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:08.674 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:08.675 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:08.675 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:08.668+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:08.685 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:08.771 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:08.768+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:08.806 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:08.806 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:08.820 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:08.872 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:08.868+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:08.942 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:08.942 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:08.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:08.973 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:08.970+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-04-26T02:24:09.060 INFO:tasks.rados.rados.0.smithi175.stdout:93: done (1 left) 2024-04-26T02:24:09.061 INFO:tasks.rados.rados.0.smithi175.stdout:94: done (0 left) 2024-04-26T02:24:09.061 INFO:tasks.rados.rados.0.smithi175.stdout:95: delete oid 38 current snap is 4 2024-04-26T02:24:09.074 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:09.072+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:09.077 INFO:tasks.rados.rados.0.smithi175.stdout:95: done (0 left) 2024-04-26T02:24:09.077 INFO:tasks.rados.rados.0.smithi175.stdout:96: snap_remove snap 3 2024-04-26T02:24:09.081 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:09.082 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:09.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:09.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:09.216 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:09.212+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:09.260 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:09.260 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:09.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:09.276 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:09.272+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:09.330 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:09.331 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:09.350 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:09.350 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:09.368 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:09.369 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:09.377 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:09.372+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:09.389 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:09.389 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:09.400 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:09.401 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:09.405 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:09.406 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:09.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:09.427 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:09.427 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:09.444 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:09.445 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:09.465 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:09.465 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:09.478 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:09.476+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:09.484 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:09.484 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:09.505 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:09.505 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:09.524 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:09.524 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:09.530 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:09.535 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:09.545 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:09.546 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:09.546 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:09.562 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:09.579 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:09.572+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:09.582 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:09.583 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:09.602 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:09.602 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:09.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:09.600+0000 7fc765674640 0 -- 172.21.15.59:0/3079073069 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7fc760223c40 msgr2=0x7fc760226030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:09.625 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:09.626 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:09.668 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:09.669 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:09.669 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:09.669 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:09.669 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:09.680 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:09.676+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:09.683 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:09.780 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:09.776+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs6 34/31 ECSubWrite(tid=0, reqid=client.4589.0:1, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:02.006063+0000", 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.8458063070000001, 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019878029999999998, 2024-04-26T02:24:09.855 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006063+0000", 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006063+0000", 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006064+0000", 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5100000000000001e-07 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006110+0000", 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6471000000000003e-05 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006155+0000", 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4968e-05 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006168+0000", 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3063e-05 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006276+0000", 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010813 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.006286+0000", 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2289999999999992e-06 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.007957+0000", 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001671521 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.008051+0000", 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4069999999999999e-05 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 33/31 ECSubWrite(tid=0, reqid=client.4589.0:7, at_version=33'1, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:02.009927+0000", 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.8419426989999996, 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031921229999999998, 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.009927+0000", 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.009927+0000", 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.009928+0000", 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6300000000000004e-07 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010034+0000", 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010628699999999999 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010066+0000", 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1868e-05 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010090+0000", 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4076000000000001e-05 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010235+0000", 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014546900000000001 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010244+0000", 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6670000000000002e-06 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.013077+0000", 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0028325249999999998 2024-04-26T02:24:09.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.013119+0000", 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2468000000000001e-05 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 33/31 ECSubWrite(tid=1, reqid=client.4589.0:8, at_version=33'2, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:02.010143+0000", 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.8417265059999997, 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030007760000000001, 2024-04-26T02:24:09.864 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010143+0000", 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010143+0000", 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010144+0000", 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.16e-07 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010198+0000", 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3655e-05 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010239+0000", 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1298000000000003e-05 2024-04-26T02:24:09.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010257+0000", 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8187000000000001e-05 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010885+0000", 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000627492 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010896+0000", 2024-04-26T02:24:09.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0881e-05 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.013124+0000", 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002228032 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.013144+0000", 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0315000000000001e-05 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.868 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs6 34/31 ECSubWrite(tid=1, reqid=client.4589.0:2, at_version=34'2, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:02.010365+0000", 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.8415045780000003, 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002942072, 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010365+0000", 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010365+0000", 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010371+0000", 2024-04-26T02:24:09.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.297e-06 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010406+0000", 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4459000000000003e-05 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010430+0000", 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3811999999999998e-05 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.010448+0000", 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8133000000000001e-05 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.011277+0000", 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00082925000000000002 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.011285+0000", 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0530000000000007e-06 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.013229+0000", 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0019443469999999999 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.013307+0000", 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7720999999999997e-05 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s5 34/31 ECSubWrite(tid=0, reqid=client.4589.0:19, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:02.018098+0000", 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.8337713569999998, 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018617849999999999, 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018098+0000", 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018098+0000", 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018099+0000", 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8900000000000001e-07 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018262+0000", 2024-04-26T02:24:09.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016353599999999999 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018272+0000", 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0200999999999999e-05 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018280+0000", 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0800000000000006e-06 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018359+0000", 2024-04-26T02:24:09.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9028000000000003e-05 2024-04-26T02:24:09.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.018366+0000", 2024-04-26T02:24:09.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6810000000000001e-06 2024-04-26T02:24:09.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.019922+0000", 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001555767 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.019960+0000", 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8203e-05 2024-04-26T02:24:09.878 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 34/31 ECSubWrite(tid=2, reqid=client.4589.0:34, at_version=34'1, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:02.026181+0000", 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.8256881400000005, 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021066700000000002, 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026181+0000", 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026181+0000", 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026182+0000", 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9400000000000001e-07 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026558+0000", 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037651200000000002 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026594+0000", 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5632e-05 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026619+0000", 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4729999999999999e-05 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026727+0000", 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010880899999999999 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.026737+0000", 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9000000000000001e-06 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.028249+0000", 2024-04-26T02:24:09.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0015117209999999999 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:02.028288+0000", 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9072000000000001e-05 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.039734+0000", 2024-04-26T02:24:09.883 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8121357979999999, 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005354429, 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039734+0000", 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039734+0000", 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039735+0000", 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039794+0000", 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9098000000000002e-05 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039826+0000", 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2738999999999999e-05 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039852+0000", 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5329000000000001e-05 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040039+0000", 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000187634 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040065+0000", 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5933000000000001e-05 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.044985+0000", 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004919975 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045088+0000", 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010296100000000001 2024-04-26T02:24:09.887 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 37/31 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.043073+0000", 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8087965639999997, 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032460980000000002, 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043073+0000", 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043073+0000", 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043074+0000", 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3e-07 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043147+0000", 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3528000000000005e-05 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043173+0000", 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6035000000000001e-05 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043197+0000", 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3713000000000001e-05 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043360+0000", 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016315500000000001 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043389+0000", 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8839e-05 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046160+0000", 2024-04-26T02:24:09.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027706330000000002 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046319+0000", 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015946499999999999 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 37/31 ECSubWrite(tid=13, reqid=osd.15.0:13, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:09.892 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.047810+0000", 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8040597749999998, 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060574679999999999, 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047810+0000", 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047810+0000", 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047811+0000", 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3600000000000003e-07 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047871+0000", 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0735e-05 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048185+0000", 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031401900000000002 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048214+0000", 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209e-05 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048905+0000", 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069098800000000002 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048927+0000", 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053781+0000", 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048537010000000002 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053867+0000", 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6397000000000006e-05 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 37/31 ECSubWrite(tid=32, reqid=osd.13.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.050755+0000", 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8011145050000001, 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004129771, 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.897 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.050755+0000", 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.050755+0000", 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.050757+0000", 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7829999999999999e-06 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.050780+0000", 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2989e-05 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.050868+0000", 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7793999999999993e-05 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.050895+0000", 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7095999999999999e-05 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051077+0000", 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018241700000000001 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051102+0000", 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4856000000000001e-05 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054770+0000", 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036679939999999999 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054885+0000", 2024-04-26T02:24:09.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114842 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.051245+0000", 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.8006249409999997, 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037405210000000001, 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.902 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051245+0000", 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051245+0000", 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051246+0000", 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.753e-06 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051272+0000", 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5989000000000001e-05 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051306+0000", 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3835999999999999e-05 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051329+0000", 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3074999999999998e-05 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051581+0000", 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025134199999999999 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051607+0000", 2024-04-26T02:24:09.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6582999999999999e-05 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054895+0000", 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032876889999999999 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054985+0000", 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0253999999999993e-05 2024-04-26T02:24:09.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 38/31 ECSubWrite(tid=15, reqid=osd.15.0:15, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.034547+0000", 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.8173222490000001, 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004671489, 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.907 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034547+0000", 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034547+0000", 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034548+0000", 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4600000000000004e-07 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034598+0000", 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0145000000000002e-05 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034631+0000", 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3049000000000002e-05 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034654+0000", 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2996000000000001e-05 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034835+0000", 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018020800000000001 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034851+0000", 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6793e-05 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.039119+0000", 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042677519999999997 2024-04-26T02:24:09.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.039219+0000", 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.98e-05 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041065+0000", 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.8108044899999998, 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052047999999999999, 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041065+0000", 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041065+0000", 2024-04-26T02:24:09.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041066+0000", 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7000000000000004e-07 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041160+0000", 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3770999999999994e-05 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041195+0000", 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5132000000000002e-05 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041219+0000", 2024-04-26T02:24:09.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4389e-05 2024-04-26T02:24:09.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041818+0000", 2024-04-26T02:24:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059878500000000001 2024-04-26T02:24:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041847+0000", 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8555999999999999e-05 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046147+0000", 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043004180000000003 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046270+0000", 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122979 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:09.920 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.8099906450000001, 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085372480000000008, 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041880+0000", 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1999999999999998e-07 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041925+0000", 2024-04-26T02:24:09.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4909e-05 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041954+0000", 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8889000000000001e-05 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042023+0000", 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9521000000000001e-05 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042984+0000", 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096037100000000001 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.043008+0000", 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4519e-05 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050324+0000", 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073160580000000003 2024-04-26T02:24:09.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050416+0000", 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2060999999999998e-05 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.044860+0000", 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.8070092199999999, 2024-04-26T02:24:09.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056374570000000002, 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044860+0000", 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044860+0000", 2024-04-26T02:24:09.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044862+0000", 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6470000000000001e-06 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044888+0000", 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5822000000000001e-05 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044917+0000", 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8653000000000002e-05 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044939+0000", 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2255999999999998e-05 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.045089+0000", 2024-04-26T02:24:09.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150715 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.045113+0000", 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3699000000000001e-05 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050428+0000", 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053147940000000003 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050498+0000", 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870999999999996e-05 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.056624+0000", 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.7952453310000003, 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048797700000000003, 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056624+0000", 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056624+0000", 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056625+0000", 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.023e-06 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056650+0000", 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4280000000000001e-05 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056677+0000", 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6982e-05 2024-04-26T02:24:09.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056696+0000", 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9315999999999999e-05 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056914+0000", 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218097 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056935+0000", 2024-04-26T02:24:09.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0548999999999999e-05 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061419+0000", 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044849219999999997 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061504+0000", 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4600999999999999e-05 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 38/31 ECSubWrite(tid=39, reqid=osd.13.0:34, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.061408+0000", 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.7904615719999999, 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024844670000000002, 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061408+0000", 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061408+0000", 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061410+0000", 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.024e-06 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061438+0000", 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7562000000000001e-05 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061470+0000", 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2239000000000001e-05 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061494+0000", 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4413000000000002e-05 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061644+0000", 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000149278 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061662+0000", 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8504000000000001e-05 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.063799+0000", 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021371739999999999 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.063893+0000", 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3273e-05 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s5 39/31 ECSubWrite(tid=16, reqid=client.4589.0:211, at_version=39'9, trim_to=0'0, roll_forward_to=34'7))", 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:09.942 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.7615290859999999, 2024-04-26T02:24:09.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061710209999999996, 2024-04-26T02:24:09.943 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.943 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.943 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.943 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:09.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:09.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:09.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4399999999999999e-07 2024-04-26T02:24:09.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090828+0000", 2024-04-26T02:24:09.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000487061 2024-04-26T02:24:09.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090865+0000", 2024-04-26T02:24:09.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6256e-05 2024-04-26T02:24:09.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090890+0000", 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5802000000000001e-05 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.091065+0000", 2024-04-26T02:24:09.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000174945 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.091095+0000", 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9105999999999999e-05 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.096411+0000", 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053165299999999999 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.096512+0000", 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010047699999999999 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s5 39/31 ECSubWrite(tid=17, reqid=client.4589.0:212, at_version=39'10, trim_to=0'0, roll_forward_to=34'7))", 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:07.092923+0000", 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.7589469449999999, 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042530390000000001, 2024-04-26T02:24:09.952 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.092923+0000", 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.092923+0000", 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.092925+0000", 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9269999999999999e-06 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.093181+0000", 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025608199999999998 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.093214+0000", 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3161999999999999e-05 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.093237+0000", 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2679000000000001e-05 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.093905+0000", 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00066886699999999996 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.093937+0000", 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1649000000000001e-05 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.097098+0000", 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031604929999999999 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.097176+0000", 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.818e-05 2024-04-26T02:24:09.956 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s5 39/31 ECSubWrite(tid=18, reqid=client.4589.0:213, at_version=39'11, trim_to=0'0, roll_forward_to=34'7))", 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:07.094281+0000", 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.7575890300000001, 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029650760000000001, 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:09.957 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.094281+0000", 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.094281+0000", 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:09.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.094282+0000", 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.313e-06 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.094323+0000", 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1585999999999998e-05 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.094354+0000", 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0459000000000001e-05 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:09.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.094375+0000", 2024-04-26T02:24:09.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1186e-05 2024-04-26T02:24:09.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:09.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.095172+0000", 2024-04-26T02:24:09.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00079649199999999999 2024-04-26T02:24:09.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:09.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.095185+0000", 2024-04-26T02:24:09.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3293e-05 2024-04-26T02:24:09.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:09.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.097190+0000", 2024-04-26T02:24:09.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002005555 2024-04-26T02:24:09.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:09.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:09.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.097246+0000", 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5192000000000003e-05 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:09.963 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:09.966 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:09.966 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:09.960+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:10.066 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:10.062+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:10.071 INFO:tasks.rados.rados.0.smithi175.stdout:96: done (0 left) 2024-04-26T02:24:10.071 INFO:tasks.rados.rados.0.smithi175.stdout:97: rollback oid 37 current snap is 4 2024-04-26T02:24:10.071 INFO:tasks.rados.rados.0.smithi175.stdout:97: done (0 left) 2024-04-26T02:24:10.071 INFO:tasks.rados.rados.0.smithi175.stdout:98: read oid 35 snap -1 2024-04-26T02:24:10.071 INFO:tasks.rados.rados.0.smithi175.stdout:98: expect (ObjNum 9 snap 0 seq_num 9) 2024-04-26T02:24:10.071 INFO:tasks.rados.rados.0.smithi175.stdout:99: delete oid 15 current snap is 4 2024-04-26T02:24:10.080 INFO:tasks.rados.rados.0.smithi175.stdout:99: done (1 left) 2024-04-26T02:24:10.080 INFO:tasks.rados.rados.0.smithi175.stdout:100: rmattr oid 50 current snap is 4 2024-04-26T02:24:10.080 INFO:tasks.rados.rados.0.smithi175.stdout:100: done (1 left) 2024-04-26T02:24:10.080 INFO:tasks.rados.rados.0.smithi175.stdout:101: delete oid 29 current snap is 4 2024-04-26T02:24:10.092 INFO:tasks.rados.rados.0.smithi175.stdout:98: expect (ObjNum 9 snap 0 seq_num 9) 2024-04-26T02:24:10.105 INFO:tasks.rados.rados.0.smithi175.stdout:98: done (1 left) 2024-04-26T02:24:10.105 INFO:tasks.rados.rados.0.smithi175.stdout:101: done (0 left) 2024-04-26T02:24:10.105 INFO:tasks.rados.rados.0.smithi175.stdout:102: delete oid 17 current snap is 4 2024-04-26T02:24:10.106 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:10.106 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:10.106 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:10.107 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:10.109 INFO:tasks.rados.rados.0.smithi175.stdout:102: done (0 left) 2024-04-26T02:24:10.109 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 21 current snap is 4 2024-04-26T02:24:10.109 INFO:tasks.rados.rados.0.smithi175.stdout:103: seq_num 72 ranges {0=442368,442368=720896,1163264=49152} 2024-04-26T02:24:10.117 INFO:tasks.rados.rados.0.smithi175.stdout:103: writing smithi17529564-21 from 0 to 442368 tid 1 2024-04-26T02:24:10.123 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:10.126 INFO:tasks.rados.rados.0.smithi175.stdout:103: writing smithi17529564-21 from 442368 to 1163264 tid 2 2024-04-26T02:24:10.127 INFO:tasks.rados.rados.0.smithi175.stdout:103: writing smithi17529564-21 from 1163264 to 1212416 tid 3 2024-04-26T02:24:10.127 INFO:tasks.rados.rados.0.smithi175.stdout:104: delete oid 14 current snap is 4 2024-04-26T02:24:10.127 INFO:tasks.rados.rados.0.smithi175.stdout:103: finishing write tid 1 to smithi17529564-21 2024-04-26T02:24:10.132 INFO:tasks.rados.rados.0.smithi175.stdout:104: done (1 left) 2024-04-26T02:24:10.132 INFO:tasks.rados.rados.0.smithi175.stdout:105: read oid 33 snap -1 2024-04-26T02:24:10.133 INFO:tasks.rados.rados.0.smithi175.stdout:105: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:24:10.133 INFO:tasks.rados.rados.0.smithi175.stdout:106: rollback oid 16 current snap is 4 2024-04-26T02:24:10.133 INFO:tasks.rados.rados.0.smithi175.stdout:106: done (2 left) 2024-04-26T02:24:10.133 INFO:tasks.rados.rados.0.smithi175.stdout:107: delete oid 23 current snap is 4 2024-04-26T02:24:10.133 INFO:tasks.rados.rados.0.smithi175.stdout:103: finishing write tid 2 to smithi17529564-21 2024-04-26T02:24:10.133 INFO:tasks.rados.rados.0.smithi175.stdout:103: finishing write tid 3 to smithi17529564-21 2024-04-26T02:24:10.136 INFO:tasks.rados.rados.0.smithi175.stdout:103: finishing write tid 4 to smithi17529564-21 2024-04-26T02:24:10.136 INFO:tasks.rados.rados.0.smithi175.stdout:107: done (2 left) 2024-04-26T02:24:10.137 INFO:tasks.rados.rados.0.smithi175.stdout:108: read oid 41 snap -1 2024-04-26T02:24:10.137 INFO:tasks.rados.rados.0.smithi175.stdout:108: expect (ObjNum 40 snap 0 seq_num 40) 2024-04-26T02:24:10.137 INFO:tasks.rados.rados.0.smithi175.stdout:109: setattr oid 15 current snap is 4 2024-04-26T02:24:10.140 INFO:tasks.rados.rados.0.smithi175.stdout:103: finishing write tid 5 to smithi17529564-21 2024-04-26T02:24:10.141 INFO:tasks.rados.rados.0.smithi175.stdout:103: oid 21 updating version 0 to 15 2024-04-26T02:24:10.141 INFO:tasks.rados.rados.0.smithi175.stdout:103: oid 21 version 15 is already newer than 13 2024-04-26T02:24:10.141 INFO:tasks.rados.rados.0.smithi175.stdout:103: oid 21 version 15 is already newer than 14 2024-04-26T02:24:10.141 INFO:tasks.rados.rados.0.smithi175.stdout:103: oid 21 updating version 15 to 16 2024-04-26T02:24:10.142 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 21 v 16 (ObjNum 72 snap 4 seq_num 72) dirty exists 2024-04-26T02:24:10.142 INFO:tasks.rados.rados.0.smithi175.stdout:103: left oid 21 (ObjNum 72 snap 4 seq_num 72) 2024-04-26T02:24:10.142 INFO:tasks.rados.rados.0.smithi175.stdout:103: done (3 left) 2024-04-26T02:24:10.142 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 28 current snap is 4 2024-04-26T02:24:10.142 INFO:tasks.rados.rados.0.smithi175.stdout:110: seq_num 75 ranges {458752=491520,950272=770048} 2024-04-26T02:24:10.148 INFO:tasks.rados.rados.0.smithi175.stdout:110: writing smithi17529564-28 from 458752 to 950272 tid 1 2024-04-26T02:24:10.153 INFO:tasks.rados.rados.0.smithi175.stdout:110: writing smithi17529564-28 from 950272 to 1720320 tid 2 2024-04-26T02:24:10.153 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 6 current snap is 4 2024-04-26T02:24:10.153 INFO:tasks.rados.rados.0.smithi175.stdout:111: seq_num 76 ranges {0=507904,507904=507904,1015808=262144} 2024-04-26T02:24:10.157 INFO:tasks.rados.rados.0.smithi175.stdout:111: writing smithi17529564-6 from 0 to 507904 tid 1 2024-04-26T02:24:10.161 INFO:tasks.rados.rados.0.smithi175.stdout:111: writing smithi17529564-6 from 507904 to 1015808 tid 2 2024-04-26T02:24:10.163 INFO:tasks.rados.rados.0.smithi175.stdout:111: writing smithi17529564-6 from 1015808 to 1277952 tid 3 2024-04-26T02:24:10.163 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 38 current snap is 4 2024-04-26T02:24:10.163 INFO:tasks.rados.rados.0.smithi175.stdout:112: seq_num 77 ranges {0=524288,524288=524288,1048576=245760} 2024-04-26T02:24:10.166 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:10.160+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:10.167 INFO:tasks.rados.rados.0.smithi175.stdout:112: writing smithi17529564-38 from 0 to 524288 tid 1 2024-04-26T02:24:10.172 INFO:tasks.rados.rados.0.smithi175.stdout:112: writing smithi17529564-38 from 524288 to 1048576 tid 2 2024-04-26T02:24:10.173 INFO:tasks.rados.rados.0.smithi175.stdout:112: writing smithi17529564-38 from 1048576 to 1294336 tid 3 2024-04-26T02:24:10.173 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 16 current snap is 4 2024-04-26T02:24:10.174 INFO:tasks.rados.rados.0.smithi175.stdout:113: seq_num 78 ranges {262144=557056,819200=671744,1490944=98304} 2024-04-26T02:24:10.179 INFO:tasks.rados.rados.0.smithi175.stdout:113: writing smithi17529564-16 from 262144 to 819200 tid 1 2024-04-26T02:24:10.185 INFO:tasks.rados.rados.0.smithi175.stdout:113: writing smithi17529564-16 from 819200 to 1490944 tid 2 2024-04-26T02:24:10.186 INFO:tasks.rados.rados.0.smithi175.stdout:113: writing smithi17529564-16 from 1490944 to 1589248 tid 3 2024-04-26T02:24:10.186 INFO:tasks.rados.rados.0.smithi175.stdout:114: snap_create 2024-04-26T02:24:10.186 INFO:tasks.rados.rados.0.smithi175.stdout:108: expect (ObjNum 40 snap 0 seq_num 40) 2024-04-26T02:24:10.225 INFO:tasks.rados.rados.0.smithi175.stdout:105: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:24:10.248 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 15 v 37 (ObjNum -1183345344 snap 21952 seq_num 304) dirty exists 2024-04-26T02:24:10.248 INFO:tasks.rados.rados.0.smithi175.stdout:110: finishing write tid 1 to smithi17529564-28 2024-04-26T02:24:10.248 INFO:tasks.rados.rados.0.smithi175.stdout:110: finishing write tid 2 to smithi17529564-28 2024-04-26T02:24:10.248 INFO:tasks.rados.rados.0.smithi175.stdout:110: finishing write tid 3 to smithi17529564-28 2024-04-26T02:24:10.248 INFO:tasks.rados.rados.0.smithi175.stdout:110: finishing write tid 4 to smithi17529564-28 2024-04-26T02:24:10.248 INFO:tasks.rados.rados.0.smithi175.stdout:110: oid 28 updating version 0 to 18 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:110: oid 28 updating version 18 to 19 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:110: oid 28 version 19 is already newer than 17 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 28 v 19 (ObjNum 75 snap 4 seq_num 75) dirty exists 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:110: left oid 28 (ObjNum 75 snap 4 seq_num 75) 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: finishing write tid 1 to smithi17529564-6 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: finishing write tid 2 to smithi17529564-6 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: finishing write tid 3 to smithi17529564-6 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: finishing write tid 4 to smithi17529564-6 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: finishing write tid 5 to smithi17529564-6 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: oid 6 updating version 0 to 10 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: oid 6 updating version 10 to 11 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: oid 6 updating version 11 to 12 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:111: oid 6 version 12 is already newer than 9 2024-04-26T02:24:10.249 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 6 v 12 (ObjNum 76 snap 4 seq_num 76) dirty exists 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:111: left oid 6 (ObjNum 76 snap 4 seq_num 76) 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: finishing write tid 1 to smithi17529564-38 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: finishing write tid 2 to smithi17529564-38 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: finishing write tid 3 to smithi17529564-38 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: finishing write tid 4 to smithi17529564-38 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:113: finishing write tid 1 to smithi17529564-16 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: finishing write tid 5 to smithi17529564-38 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: oid 38 updating version 0 to 40 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: oid 38 version 40 is already newer than 38 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: oid 38 updating version 40 to 41 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: oid 38 version 41 is already newer than 39 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 38 v 41 (ObjNum 77 snap 4 seq_num 77) dirty exists 2024-04-26T02:24:10.250 INFO:tasks.rados.rados.0.smithi175.stdout:112: left oid 38 (ObjNum 77 snap 4 seq_num 77) 2024-04-26T02:24:10.262 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:10.262 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:10.262 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:10.262 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:10.262 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:10.268 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:10.264+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:10.276 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:10.369 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:10.366+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:10.395 INFO:tasks.rados.rados.0.smithi175.stdout:113: finishing write tid 2 to smithi17529564-16 2024-04-26T02:24:10.395 INFO:tasks.rados.rados.0.smithi175.stdout:113: finishing write tid 3 to smithi17529564-16 2024-04-26T02:24:10.397 INFO:tasks.rados.rados.0.smithi175.stdout:113: finishing write tid 4 to smithi17529564-16 2024-04-26T02:24:10.400 INFO:tasks.rados.rados.0.smithi175.stdout:113: finishing write tid 5 to smithi17529564-16 2024-04-26T02:24:10.400 INFO:tasks.rados.rados.0.smithi175.stdout:113: oid 16 updating version 0 to 16 2024-04-26T02:24:10.400 INFO:tasks.rados.rados.0.smithi175.stdout:113: oid 16 updating version 16 to 17 2024-04-26T02:24:10.401 INFO:tasks.rados.rados.0.smithi175.stdout:113: oid 16 updating version 17 to 18 2024-04-26T02:24:10.401 INFO:tasks.rados.rados.0.smithi175.stdout:113: oid 16 version 18 is already newer than 15 2024-04-26T02:24:10.401 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 16 v 18 (ObjNum 78 snap 4 seq_num 78) dirty exists 2024-04-26T02:24:10.401 INFO:tasks.rados.rados.0.smithi175.stdout:113: left oid 16 (ObjNum 78 snap 4 seq_num 78) 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.4103330239999998, 2024-04-26T02:24:10.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011126728000000001, 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034940+0000", 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.663e-06 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034988+0000", 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7794999999999999e-05 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035017+0000", 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9139e-05 2024-04-26T02:24:10.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035039+0000", 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2178999999999999e-05 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035616+0000", 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057682000000000002 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035639+0000", 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2915999999999999e-05 2024-04-26T02:24:10.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045974+0000", 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01033568 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046065+0000", 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0536000000000002e-05 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.452 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.042615+0000", 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.402656253, 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044871319999999996, 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042615+0000", 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042615+0000", 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042616+0000", 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5700000000000002e-07 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042671+0000", 2024-04-26T02:24:10.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5645e-05 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042695+0000", 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3884999999999999e-05 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042716+0000", 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0815999999999999e-05 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042900+0000", 2024-04-26T02:24:10.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018415 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042924+0000", 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4105e-05 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046973+0000", 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040484529999999996 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047102+0000", 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000129321 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.042769+0000", 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.402502342, 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075953629999999999, 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042769+0000", 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042769+0000", 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042770+0000", 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:10.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042823+0000", 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2791000000000003e-05 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042847+0000", 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4249000000000001e-05 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042864+0000", 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7413000000000001e-05 2024-04-26T02:24:10.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043864+0000", 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0009993370000000001 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043887+0000", 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3422e-05 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050274+0000", 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063871860000000004 2024-04-26T02:24:10.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050364+0000", 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0007999999999996e-05 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 37/31 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.043801+0000", 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.4014700829999995, 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066390779999999996, 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.461 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043801+0000", 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043801+0000", 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043803+0000", 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7570000000000001e-06 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043850+0000", 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7240999999999997e-05 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043880+0000", 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0312e-05 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043902+0000", 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2039e-05 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044115+0000", 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021216599999999999 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044139+0000", 2024-04-26T02:24:10.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4042000000000001e-05 2024-04-26T02:24:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050389+0000", 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062503810000000002 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050440+0000", 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1140000000000002e-05 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=27, reqid=osd.8.0:26, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:10.466 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.047465+0000", 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.397806568, 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054258980000000002, 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047465+0000", 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047465+0000", 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047467+0000", 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0669999999999999e-06 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047493+0000", 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6749000000000001e-05 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047555+0000", 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1489999999999996e-05 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047579+0000", 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4148999999999999e-05 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047775+0000", 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019593599999999999 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047789+0000", 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3879e-05 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052798+0000", 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050089109999999996 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052891+0000", 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2717e-05 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.470 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.047959+0000", 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.3973124180000003, 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050013519999999997, 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047959+0000", 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047959+0000", 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047960+0000", 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.59e-06 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048009+0000", 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8897999999999998e-05 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048039+0000", 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9882e-05 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048059+0000", 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9908999999999999e-05 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048272+0000", 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000213076 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048294+0000", 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1882000000000002e-05 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052896+0000", 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046023740000000002 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052960+0000", 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3740999999999998e-05 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.474 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.051804+0000", 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.39346719, 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042472090000000001, 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051804+0000", 2024-04-26T02:24:10.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051804+0000", 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051806+0000", 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8929999999999999e-06 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051911+0000", 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000105152 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051977+0000", 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5701e-05 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052001+0000", 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3923000000000001e-05 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052159+0000", 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015804299999999999 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052186+0000", 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7708999999999998e-05 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.055934+0000", 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003747041 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056051+0000", 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000117747 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=65, reqid=osd.0.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.056216+0000", 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.3890553859999999, 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049998380000000004, 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.479 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056216+0000", 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056216+0000", 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056218+0000", 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7630000000000001e-06 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056261+0000", 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3105999999999997e-05 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056291+0000", 2024-04-26T02:24:10.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0437999999999999e-05 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056315+0000", 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3543000000000001e-05 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056624+0000", 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030905400000000001 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056649+0000", 2024-04-26T02:24:10.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4776000000000001e-05 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061142+0000", 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044931959999999996 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061216+0000", 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3961999999999994e-05 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=29, reqid=osd.8.0:28, at_version=0'0, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.056393+0000", 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.3888783990000002, 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049395730000000001, 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056393+0000", 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056393+0000", 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056394+0000", 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2929999999999999e-06 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056419+0000", 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4909000000000002e-05 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056445+0000", 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6122000000000002e-05 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056466+0000", 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1212999999999998e-05 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.057127+0000", 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00066085000000000004 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.057148+0000", 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1186e-05 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061248+0000", 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040996469999999997 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061332+0000", 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4352999999999997e-05 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=30, reqid=client.4589.0:197, at_version=37'23, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.062322+0000", 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.3829489390000003, 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074342230000000002, 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062322+0000", 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062322+0000", 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062436+0000", 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011413699999999999 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062708+0000", 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027112700000000002 2024-04-26T02:24:10.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062746+0000", 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8702999999999999e-05 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062764+0000", 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8029999999999998e-05 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062913+0000", 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148274 2024-04-26T02:24:10.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062942+0000", 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9218999999999999e-05 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.069685+0000", 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067435689999999996 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.492 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.069757+0000", 2024-04-26T02:24:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1163999999999998e-05 2024-04-26T02:24:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.493 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=31, reqid=client.4589.0:198, at_version=37'24, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.066741+0000", 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.3785301829999996, 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041561310000000004, 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.066741+0000", 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.494 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.066741+0000", 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.066743+0000", 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5290000000000001e-06 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.495 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.066944+0000", 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020188199999999999 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.066977+0000", 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2802000000000002e-05 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067001+0000", 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3269e-05 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.496 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067494+0000", 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049302799999999996 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067518+0000", 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4598999999999999e-05 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.070810+0000", 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032921890000000001 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.497 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.070897+0000", 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6833e-05 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.040122+0000", 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.4051490580000001, 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051440319999999998, 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.498 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040122+0000", 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040122+0000", 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.499 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040124+0000", 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.66e-06 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040165+0000", 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0669e-05 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040189+0000", 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4482e-05 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.500 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040204+0000", 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4532000000000001e-05 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040422+0000", 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021852899999999999 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040447+0000", 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5299e-05 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.501 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.045189+0000", 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047420880000000002 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.045266+0000", 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6773000000000005e-05 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 38/31 ECSubWrite(tid=49, reqid=osd.12.0:49, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.041802+0000", 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.4034687779999997, 2024-04-26T02:24:10.502 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047115029999999997, 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041802+0000", 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041802+0000", 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.503 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041803+0000", 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3399999999999999e-07 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041853+0000", 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9681000000000001e-05 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041880+0000", 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6801999999999999e-05 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.504 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041902+0000", 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1996000000000001e-05 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042042+0000", 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140934 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042068+0000", 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5262e-05 2024-04-26T02:24:10.505 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.046406+0000", 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043385020000000002 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.046514+0000", 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107692 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.506 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.041872+0000", 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.4033990310000002, 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044018089999999996, 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041872+0000", 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.507 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041872+0000", 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041874+0000", 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041936+0000", 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2430999999999999e-05 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.508 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041970+0000", 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3671999999999999e-05 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041993+0000", 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2789000000000002e-05 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042169+0000", 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017646 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042194+0000", 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4635e-05 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.046187+0000", 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039934990000000002 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.046274+0000", 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6833e-05 2024-04-26T02:24:10.510 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 38/31 ECSubWrite(tid=37, reqid=osd.8.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=38'29))", 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.054852+0000", 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3904190170000001, 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004369403, 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054852+0000", 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054852+0000", 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054854+0000", 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.637e-06 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054875+0000", 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1132e-05 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054903+0000", 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7915999999999998e-05 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054926+0000", 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2606e-05 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055097+0000", 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017108600000000001 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055129+0000", 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2731999999999998e-05 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059120+0000", 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039905749999999997 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059222+0000", 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010171900000000001 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 38/31 ECSubWrite(tid=51, reqid=osd.12.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.055448+0000", 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3898231140000004, 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061122040000000004, 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055448+0000", 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055448+0000", 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055449+0000", 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1299999999999998e-07 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055471+0000", 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2456e-05 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055494+0000", 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2575999999999999e-05 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055518+0000", 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3879e-05 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055867+0000", 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034898900000000002 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055876+0000", 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0899999999999994e-06 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061474+0000", 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055981980000000004 2024-04-26T02:24:10.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061560+0000", 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6102999999999999e-05 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 38/31 ECSubWrite(tid=69, reqid=osd.0.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056145+0000", 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3891261410000002, 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052890560000000003, 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.519 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056145+0000", 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056145+0000", 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056147+0000", 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7460000000000001e-06 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056175+0000", 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8212e-05 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056198+0000", 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3163000000000002e-05 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056219+0000", 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0971999999999998e-05 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056463+0000", 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024403700000000001 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056489+0000", 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5412999999999999e-05 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061351+0000", 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048626169999999996 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061434+0000", 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2896000000000001e-05 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056350+0000", 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3889216830000004, 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050521029999999996, 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.524 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056350+0000", 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056350+0000", 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056351+0000", 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.13e-06 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056371+0000", 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0803000000000001e-05 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056395+0000", 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3849000000000002e-05 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056413+0000", 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7946000000000001e-05 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056500+0000", 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7064999999999994e-05 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056512+0000", 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1627000000000001e-05 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061274+0000", 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047622910000000001 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061402+0000", 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012739199999999999 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 38/31 ECSubWrite(tid=38, reqid=osd.8.0:38, at_version=38'31, trim_to=0'0, roll_forward_to=38'29))", 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056855+0000", 2024-04-26T02:24:10.528 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3884163699999998, 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048112490000000001, 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056855+0000", 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056855+0000", 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056856+0000", 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3030000000000001e-06 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056933+0000", 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6537000000000003e-05 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056964+0000", 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0828999999999999e-05 2024-04-26T02:24:10.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056984+0000", 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0809e-05 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.057074+0000", 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0158e-05 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.057084+0000", 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0969999999999995e-06 2024-04-26T02:24:10.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061566+0000", 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044824569999999996 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061666+0000", 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100059 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 42/31 ECSubWrite(tid=42, reqid=osd.8.0:42, at_version=42'35, trim_to=0'0, roll_forward_to=41'33))", 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.072164+0000", 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.37310675599999998, 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049618880000000002, 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072164+0000", 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072164+0000", 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072165+0000", 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3700000000000001e-07 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072207+0000", 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.227e-05 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072224+0000", 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7088e-05 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072249+0000", 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4570999999999999e-05 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072367+0000", 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000117846 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072389+0000", 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1832999999999999e-05 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.077054+0000", 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046658799999999999 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.077126+0000", 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1963000000000002e-05 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.536 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.537 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.537 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:10.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:10.539 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:10.536+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:10.639 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:10.636+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:10.708 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:10.709 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:10.709 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:10.721 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:10.740 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:10.736+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:10.838 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:10.839 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:10.839 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:10.841 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:10.840+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:10.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:10.943 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:10.940+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:10.974 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:10.974 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:10.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:10.974 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:10.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.974 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034101+0000", 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9372076079999996, 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051545200000000001, 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034101+0000", 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034101+0000", 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034101+0000", 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4799999999999998e-07 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034171+0000", 2024-04-26T02:24:10.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9549999999999996e-05 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034207+0000", 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6687999999999998e-05 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034232+0000", 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4966000000000001e-05 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034426+0000", 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019332600000000001 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034450+0000", 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3901999999999999e-05 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039160+0000", 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047099159999999998 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039255+0000", 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5624000000000005e-05 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.035020+0000", 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9362882470000002, 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096975120000000001, 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.979 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035020+0000", 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035020+0000", 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035022+0000", 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5430000000000001e-06 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035070+0000", 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8245000000000003e-05 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035099+0000", 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9416000000000001e-05 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035122+0000", 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3218999999999999e-05 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036221+0000", 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001098506 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036289+0000", 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7999999999999999e-05 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044636+0000", 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.008347396 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044717+0000", 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1186999999999994e-05 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:10.983 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.036417+0000", 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9348910559999997, 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079134259999999994, 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036417+0000", 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036417+0000", 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036418+0000", 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036466+0000", 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8111000000000001e-05 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036503+0000", 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7302000000000003e-05 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036527+0000", 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3923000000000001e-05 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036714+0000", 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018633899999999999 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036738+0000", 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4522e-05 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044219+0000", 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074811369999999997 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044331+0000", 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000111402 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.039629+0000", 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9316787900000003, 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0076596160000000002, 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039629+0000", 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039629+0000", 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039630+0000", 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6000000000000002e-07 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039690+0000", 2024-04-26T02:24:10.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9243999999999997e-05 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039714+0000", 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4358999999999998e-05 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039736+0000", 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2272999999999998e-05 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039915+0000", 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017908600000000001 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.039939+0000", 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3825999999999999e-05 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047202+0000", 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072633180000000004 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047289+0000", 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6650000000000006e-05 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.041639+0000", 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9296690329999997, 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009070982, 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.992 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041639+0000", 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041639+0000", 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041641+0000", 2024-04-26T02:24:10.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8160000000000001e-06 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041694+0000", 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3127999999999997e-05 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041727+0000", 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2756000000000003e-05 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041748+0000", 2024-04-26T02:24:10.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1229e-05 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042012+0000", 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026354900000000002 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042034+0000", 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2138999999999999e-05 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050631+0000", 2024-04-26T02:24:10.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085971450000000005 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050710+0000", 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9220000000000004e-05 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 37/31 ECSubWrite(tid=27, reqid=osd.8.0:26, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.047376+0000", 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.923932271, 2024-04-26T02:24:10.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055887350000000001, 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047376+0000", 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047376+0000", 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047378+0000", 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6729999999999999e-06 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047404+0000", 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6732000000000001e-05 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047432+0000", 2024-04-26T02:24:10.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8062999999999999e-05 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047455+0000", 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2949e-05 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047611+0000", 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000155394 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047635+0000", 2024-04-26T02:24:10.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4502e-05 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052881+0000", 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005245492 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052965+0000", 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3930000000000004e-05 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.000 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9233243089999998, 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050406499999999998, 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047985+0000", 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5540000000000001e-06 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048033+0000", 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7883999999999998e-05 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048061+0000", 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7858999999999999e-05 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048085+0000", 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3558999999999999e-05 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048225+0000", 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014061799999999999 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048267+0000", 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1442000000000001e-05 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052973+0000", 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047059099999999998 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.053025+0000", 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1823999999999997e-05 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.004 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 37/31 ECSubWrite(tid=179, reqid=osd.6.0:178, at_version=0'0, trim_to=0'0, roll_forward_to=37'15))", 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.050214+0000", 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.921094503, 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084084699999999995, 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050214+0000", 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050214+0000", 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050216+0000", 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0829999999999998e-06 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050306+0000", 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9713e-05 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050339+0000", 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3025000000000003e-05 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050361+0000", 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2269e-05 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050584+0000", 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022342799999999999 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050608+0000", 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3901999999999999e-05 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.058552+0000", 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079439550000000008 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.058622+0000", 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0094999999999999e-05 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.009 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 37/31 ECSubWrite(tid=30, reqid=client.4589.0:197, at_version=37'23, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.061922+0000", 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9093859179999999, 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077468779999999996, 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061922+0000", 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061922+0000", 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061924+0000", 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.776e-06 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062439+0000", 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00051531899999999998 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062470+0000", 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1078999999999998e-05 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062486+0000", 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5489999999999999e-05 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062640+0000", 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154117 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062670+0000", 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0062000000000001e-05 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.069584+0000", 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069134289999999996 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.069669+0000", 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5606000000000007e-05 2024-04-26T02:24:11.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 37/31 ECSubWrite(tid=46, reqid=client.4589.0:201, at_version=37'12, trim_to=0'0, roll_forward_to=34'10))", 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.067705+0000", 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9036031219999998, 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028514489999999998, 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067705+0000", 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067705+0000", 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067706+0000", 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067758+0000", 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2605000000000002e-05 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067784+0000", 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5316e-05 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.067805+0000", 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1259000000000001e-05 2024-04-26T02:24:11.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.068115+0000", 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031036399999999998 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.068141+0000", 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5286000000000002e-05 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.070471+0000", 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023308809999999999 2024-04-26T02:24:11.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.070557+0000", 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5107999999999999e-05 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 38/31 ECSubWrite(tid=35, reqid=osd.8.0:35, at_version=38'27, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.034272+0000", 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.9370363849999999, 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038125949999999998, 2024-04-26T02:24:11.018 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034272+0000", 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034272+0000", 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034273+0000", 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.263e-06 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034324+0000", 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1100999999999997e-05 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034354+0000", 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9711999999999999e-05 2024-04-26T02:24:11.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034376+0000", 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2552999999999999e-05 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034560+0000", 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018368900000000001 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.034585+0000", 2024-04-26T02:24:11.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4615999999999999e-05 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.037985+0000", 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034007249999999998 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.038084+0000", 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8936000000000003e-05 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.036495+0000", 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.9348137000000003, 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002967159, 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036495+0000", 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036495+0000", 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036496+0000", 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7099999999999999e-06 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036555+0000", 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8794e-05 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036589+0000", 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3849000000000001e-05 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036612+0000", 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2631999999999999e-05 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036805+0000", 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000193952 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036831+0000", 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5326000000000001e-05 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039382+0000", 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025513020000000001 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039462+0000", 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9593999999999997e-05 2024-04-26T02:24:11.026 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 38/31 ECSubWrite(tid=66, reqid=osd.0.0:66, at_version=38'31, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.039353+0000", 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.9319556039999997, 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034130779999999999, 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039353+0000", 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039353+0000", 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039353+0000", 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6400000000000001e-07 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039555+0000", 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020193199999999999 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039581+0000", 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5545e-05 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039604+0000", 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039787+0000", 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000183563 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.039815+0000", 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8115000000000001e-05 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042693+0000", 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028780289999999998 2024-04-26T02:24:11.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042766+0000", 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2347000000000004e-05 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 38/31 ECSubWrite(tid=51, reqid=osd.12.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.054742+0000", 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.9165666420000003, 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0036920899999999999, 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.031 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054742+0000", 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054742+0000", 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054748+0000", 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.246e-06 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054769+0000", 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1396e-05 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054798+0000", 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8898999999999999e-05 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054813+0000", 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5213e-05 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054957+0000", 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014406400000000001 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054982+0000", 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4953e-05 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058345+0000", 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033623989999999999 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058434+0000", 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8919999999999996e-05 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 38/31 ECSubWrite(tid=37, reqid=osd.8.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=38'29))", 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.054980+0000", 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.9163278980000005, 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060113440000000001, 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054980+0000", 2024-04-26T02:24:11.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054980+0000", 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.054982+0000", 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.097e-06 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055010+0000", 2024-04-26T02:24:11.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7107999999999999e-05 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055043+0000", 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3841999999999999e-05 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055065+0000", 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1443000000000001e-05 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055225+0000", 2024-04-26T02:24:11.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000160073 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055253+0000", 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8243e-05 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.060932+0000", 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005678504 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.060992+0000", 2024-04-26T02:24:11.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0034000000000002e-05 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 38/31 ECSubWrite(tid=69, reqid=osd.0.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056177+0000", 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.9151316359999999, 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048072330000000002, 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056177+0000", 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056177+0000", 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056178+0000", 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.37e-06 2024-04-26T02:24:11.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056214+0000", 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6429e-05 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056268+0000", 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3814999999999999e-05 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056291+0000", 2024-04-26T02:24:11.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2549e-05 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056463+0000", 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017246300000000001 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056488+0000", 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4559e-05 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.060858+0000", 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043699230000000004 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.060984+0000", 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012612499999999999 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 38/31 ECSubWrite(tid=38, reqid=osd.8.0:38, at_version=38'31, trim_to=0'0, roll_forward_to=38'29))", 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056406+0000", 2024-04-26T02:24:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.9149022919999998, 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046382960000000001, 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056406+0000", 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056406+0000", 2024-04-26T02:24:11.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056407+0000", 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3400000000000001e-06 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056459+0000", 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1638000000000003e-05 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056485+0000", 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5899000000000001e-05 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056524+0000", 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9425999999999998e-05 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056690+0000", 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016623000000000001 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056715+0000", 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4349e-05 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.060998+0000", 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042833860000000001 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061044+0000", 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6028e-05 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.048 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.058718+0000", 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.912589777, 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033091959999999999, 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058718+0000", 2024-04-26T02:24:11.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058718+0000", 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058720+0000", 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9929999999999998e-06 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058749+0000", 2024-04-26T02:24:11.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9059000000000001e-05 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058780+0000", 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0963000000000002e-05 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058816+0000", 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5358000000000003e-05 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058907+0000", 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1452000000000005e-05 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.058917+0000", 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0149000000000001e-05 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061933+0000", 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0030151520000000001 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.062028+0000", 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5069999999999996e-05 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:257 3.bs0 3:d145576f:::smithi17529564-17:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.106329+0000", 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.86497901399999999, 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038894279999999999, 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:11.053 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 257 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106329+0000", 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106329+0000", 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106340+0000", 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1206000000000001e-05 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106353+0000", 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3020000000000001e-05 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106382+0000", 2024-04-26T02:24:11.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8856e-05 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106399+0000", 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6249e-05 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106546+0000", 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014709799999999999 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:11.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.106706+0000", 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016076099999999999 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.107869+0000", 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0011627149999999999 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.109050+0000", 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001181065 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:11.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.110111+0000", 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010610319999999999 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.110219+0000", 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107426 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 42/31 ECSubWrite(tid=52, reqid=client.4589.0:283, at_version=42'40, trim_to=0'0, roll_forward_to=42'37))", 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.180496+0000", 2024-04-26T02:24:11.058 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.79081188000000002, 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029361180000000001, 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180496+0000", 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180496+0000", 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180498+0000", 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6509999999999999e-06 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180597+0000", 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8565000000000002e-05 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180628+0000", 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1705000000000002e-05 2024-04-26T02:24:11.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180648+0000", 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9448000000000001e-05 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180726+0000", 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8651000000000003e-05 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.180739+0000", 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2449000000000001e-05 2024-04-26T02:24:11.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183356+0000", 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026170659999999999 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183432+0000", 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6582999999999995e-05 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.062 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.063 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.063 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.063 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.063 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:11.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:11.065 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:11.060+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:11.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T02:24:11.089 INFO:tasks.rados.rados.0.smithi175.stdout:105: done (7 left) 2024-04-26T02:24:11.089 INFO:tasks.rados.rados.0.smithi175.stdout:108: done (6 left) 2024-04-26T02:24:11.089 INFO:tasks.rados.rados.0.smithi175.stdout:109: done (5 left) 2024-04-26T02:24:11.089 INFO:tasks.rados.rados.0.smithi175.stdout:110: done (4 left) 2024-04-26T02:24:11.089 INFO:tasks.rados.rados.0.smithi175.stdout:111: done (3 left) 2024-04-26T02:24:11.090 INFO:tasks.rados.rados.0.smithi175.stdout:112: done (2 left) 2024-04-26T02:24:11.090 INFO:tasks.rados.rados.0.smithi175.stdout:113: done (1 left) 2024-04-26T02:24:11.090 INFO:tasks.rados.rados.0.smithi175.stdout:114: done (0 left) 2024-04-26T02:24:11.090 INFO:tasks.rados.rados.0.smithi175.stdout:115: read oid 15 snap 4 2024-04-26T02:24:11.090 INFO:tasks.rados.rados.0.smithi175.stdout:115: expect (ObjNum -1183636816 snap 21952 seq_num 3087354896) 2024-04-26T02:24:11.090 INFO:tasks.rados.rados.0.smithi175.stdout:116: snap_create 2024-04-26T02:24:11.093 INFO:tasks.rados.rados.0.smithi175.stdout:115: expect (ObjNum -1183636816 snap 21952 seq_num 3087354896) 2024-04-26T02:24:11.168 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:11.160+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:11.191 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:11.191 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:11.191 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:11.191 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:11.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:11.267 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:11.264+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:11.368 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:11.368 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:11.368 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:11.368 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:11.368 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:11.369 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:11.364+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:11.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:24:11.469 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:11.466+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.9s5 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.043254+0000", 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.4632752880000002, 2024-04-26T02:24:11.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067741770000000001, 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043254+0000", 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043254+0000", 2024-04-26T02:24:11.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043255+0000", 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7299999999999995e-07 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043311+0000", 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6137999999999997e-05 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043354+0000", 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2624999999999999e-05 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043379+0000", 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5049e-05 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044138+0000", 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00075887600000000002 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044165+0000", 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6896000000000001e-05 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049942+0000", 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005777524 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050029+0000", 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6396000000000004e-05 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es4 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.043434+0000", 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.4630954120000004, 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033259560000000001, 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043434+0000", 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043434+0000", 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043435+0000", 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2299999999999999e-07 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043483+0000", 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7388000000000001e-05 2024-04-26T02:24:11.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043507+0000", 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4023e-05 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043527+0000", 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0822000000000002e-05 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043671+0000", 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014329499999999999 2024-04-26T02:24:11.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043693+0000", 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1902000000000001e-05 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046690+0000", 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029975639999999999 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046760+0000", 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0038999999999998e-05 2024-04-26T02:24:11.517 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es4 37/31 ECSubWrite(tid=32, reqid=osd.13.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.051431+0000", 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.4550990969999997, 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0041247300000000001, 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051431+0000", 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051431+0000", 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051432+0000", 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6700000000000001e-06 2024-04-26T02:24:11.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051455+0000", 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2742999999999999e-05 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051483+0000", 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7889e-05 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051504+0000", 2024-04-26T02:24:11.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0999e-05 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051635+0000", 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000131481 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.051657+0000", 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1427e-05 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.055496+0000", 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0038387429999999999 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.055555+0000", 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9778000000000003e-05 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.522 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.9s5 37/31 ECSubWrite(tid=33, reqid=osd.13.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.054004+0000", 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.4525253520000003, 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031287870000000001, 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054004+0000", 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054004+0000", 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054005+0000", 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8999999999999995e-07 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054025+0000", 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9426e-05 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054047+0000", 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2518999999999999e-05 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054069+0000", 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2286e-05 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054330+0000", 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026040299999999998 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.054354+0000", 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3719000000000001e-05 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.057062+0000", 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002707947 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.057133+0000", 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1596999999999999e-05 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.526 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es4 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.048251+0000", 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.4582790609999998, 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037333779999999999, 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048251+0000", 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048251+0000", 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048252+0000", 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6700000000000002e-07 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048293+0000", 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1158000000000001e-05 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048317+0000", 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4549000000000002e-05 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048339+0000", 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1328999999999999e-05 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048490+0000", 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015165999999999999 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.048509+0000", 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9199999999999999e-05 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.051911+0000", 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034013210000000001 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.051984+0000", 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3294000000000007e-05 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.9s5 38/31 ECSubWrite(tid=38, reqid=osd.13.0:38, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.059169+0000", 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.4473603090000005, 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002147801, 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.531 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059169+0000", 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059169+0000", 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059171+0000", 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0430000000000002e-06 2024-04-26T02:24:11.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059225+0000", 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3090999999999997e-05 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059270+0000", 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5802e-05 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059295+0000", 2024-04-26T02:24:11.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4346e-05 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059448+0000", 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000153494 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.059474+0000", 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5367e-05 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061217+0000", 2024-04-26T02:24:11.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001743639 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061317+0000", 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010001900000000001 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es4 38/31 ECSubWrite(tid=39, reqid=osd.13.0:34, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.061101+0000", 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.445428208, 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021182089999999998, 2024-04-26T02:24:11.535 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061101+0000", 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061101+0000", 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061103+0000", 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.795e-06 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061127+0000", 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3810000000000001e-05 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061155+0000", 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8359000000000001e-05 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061175+0000", 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9242e-05 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061357+0000", 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000182139 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061378+0000", 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1452999999999999e-05 2024-04-26T02:24:11.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.063135+0000", 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0017564270000000001 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.063220+0000", 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4983999999999998e-05 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.539 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:276 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3480699979999999, 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015591825, 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 276 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158464+0000", 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4240000000000003e-06 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158778+0000", 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031355400000000001 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158793+0000", 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5654e-05 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158804+0000", 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0543000000000001e-05 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158964+0000", 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015994199999999999 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.159116+0000", 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152194 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161895+0000", 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027785510000000002 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173835+0000", 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011940014000000001 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173974+0000", 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000139546 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174052+0000", 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7403000000000004e-05 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:277 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3423502979999999, 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010157334000000001, 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 277 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164186+0000", 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-06 2024-04-26T02:24:11.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164969+0000", 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00078311199999999998 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165008+0000", 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9104999999999999e-05 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165032+0000", 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4309000000000001e-05 2024-04-26T02:24:11.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167127+0000", 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020944959999999999 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167367+0000", 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023982499999999999 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.169580+0000", 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022133669999999999 2024-04-26T02:24:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173836+0000", 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042559579999999998 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174288+0000", 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045227899999999998 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174337+0000", 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8452999999999998e-05 2024-04-26T02:24:11.549 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=15, last_complete=42'9, committed=1, applied=1))", 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.164598+0000", 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.341931387, 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022165599999999998, 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164598+0000", 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164598+0000", 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164599+0000", 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9999999999999995e-07 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164608+0000", 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3899999999999993e-06 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164624+0000", 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6217000000000001e-05 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164633+0000", 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3500000000000003e-06 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.166762+0000", 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021287739999999999 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.166815+0000", 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2828999999999999e-05 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:278 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~262144] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:11.553 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3414593459999999, 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012417243999999999, 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 278 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:11.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165072+0000", 2024-04-26T02:24:11.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.956e-06 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165417+0000", 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034496100000000002 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165440+0000", 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2768999999999998e-05 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165455+0000", 2024-04-26T02:24:11.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4537e-05 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.170890+0000", 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054354399999999997 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171115+0000", 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000224634 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.172663+0000", 2024-04-26T02:24:11.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001548334 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175132+0000", 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002469073 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.177317+0000", 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021844920000000001 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.177488+0000", 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017104800000000001 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:279 3.1s0 3:8c97d9d7:::smithi17529564-6:head [setxattr _header (55) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.341052031, 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012771915999999999, 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:11.559 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 279 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165479+0000", 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.113e-06 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165484+0000", 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7940000000000002e-06 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165496+0000", 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2388999999999999e-05 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165504+0000", 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3960000000000006e-06 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174364+0000", 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088599820000000006 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174434+0000", 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9259999999999998e-05 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174903+0000", 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00046937200000000002 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175519+0000", 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00061567900000000005 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.178064+0000", 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025453030000000001 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.178250+0000", 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018562799999999999 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:280 3.1s0 3:8c97d9d7:::smithi17529564-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.341011969, 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018442278999999999, 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.564 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 280 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165519+0000", 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165523+0000", 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9400000000000004e-06 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165535+0000", 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2486e-05 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165546+0000", 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175360+0000", 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098140950000000001 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175447+0000", 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7737000000000004e-05 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179821+0000", 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043734860000000002 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179966+0000", 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014539199999999999 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183960+0000", 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039937430000000001 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.569 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=15, last_complete=42'9, committed=1, applied=1))", 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.167363+0000", 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.339166257, 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064302639999999998, 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167363+0000", 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167363+0000", 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167365+0000", 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.062e-06 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167378+0000", 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3839000000000001e-05 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167393+0000", 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4939999999999999e-05 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167407+0000", 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3942e-05 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173769+0000", 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063621119999999996 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173794+0000", 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4369e-05 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=15, last_complete=42'9, committed=1, applied=1))", 2024-04-26T02:24:11.576 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.168022+0000", 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.338507686, 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058158000000000003, 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168022+0000", 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168022+0000", 2024-04-26T02:24:11.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168023+0000", 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.7399999999999991e-07 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168029+0000", 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6030000000000004e-06 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168044+0000", 2024-04-26T02:24:11.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5148e-05 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168052+0000", 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6160000000000002e-06 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173819+0000", 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005766836 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173838+0000", 2024-04-26T02:24:11.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8623000000000001e-05 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=15, last_complete=42'9, committed=1, applied=1))", 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.168523+0000", 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.338006724, 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055374339999999999, 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168523+0000", 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168523+0000", 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168524+0000", 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4000000000000001e-07 2024-04-26T02:24:11.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168528+0000", 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.092e-06 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168542+0000", 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4157e-05 2024-04-26T02:24:11.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.168550+0000", 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.858e-06 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173897+0000", 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005347671 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174060+0000", 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016301600000000001 2024-04-26T02:24:11.583 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=16, last_complete=42'10, committed=1, applied=1))", 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.171692+0000", 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3348373419999999, 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002447098, 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171692+0000", 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171692+0000", 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171694+0000", 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5799999999999999e-06 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171702+0000", 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4460000000000001e-06 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171723+0000", 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0686000000000002e-05 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171738+0000", 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5183e-05 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174126+0000", 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023877820000000002 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174139+0000", 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3421000000000001e-05 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=16, last_complete=42'10, committed=1, applied=1))", 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.171745+0000", 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.33478484, 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002356847, 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171745+0000", 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171745+0000", 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171746+0000", 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4900000000000004e-07 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171751+0000", 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6970000000000001e-06 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171760+0000", 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1139999999999995e-06 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171766+0000", 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8480000000000003e-06 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174086+0000", 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00231978 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174102+0000", 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5458999999999999e-05 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=16, last_complete=42'10, committed=1, applied=1))", 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.171842+0000", 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3346872510000001, 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023694749999999998, 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.591 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171842+0000", 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171842+0000", 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171843+0000", 2024-04-26T02:24:11.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7100000000000002e-07 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171846+0000", 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7360000000000001e-06 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171855+0000", 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9959999999999999e-06 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171859+0000", 2024-04-26T02:24:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3089999999999997e-06 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174198+0000", 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023393009999999998 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174212+0000", 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3562e-05 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.594 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWriteReply(3.1s0 42/31 ECSubWriteReply(tid=16, last_complete=42'10, committed=1, applied=1))", 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.171883+0000", 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.3346469670000001, 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022920900000000001, 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171883+0000", 2024-04-26T02:24:11.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171883+0000", 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171883+0000", 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.35e-07 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171885+0000", 2024-04-26T02:24:11.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7829999999999999e-06 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171890+0000", 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8799999999999999e-06 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171893+0000", 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.811e-06 2024-04-26T02:24:11.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174161+0000", 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022678849999999999 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174175+0000", 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3495999999999999e-05 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:11.598 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:11.600 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:24:11.601 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:11.598+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:11.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:11.701 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:11.696+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:11.770 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:11.770 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:11.770 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:11.771 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:11.784 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:24:11.802 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:11.800+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:11.807 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:11.807 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:11.828 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:11.829 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:11.851 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:11.851 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:11.872 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:11.873 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:11.893 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:11.894 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:11.902 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:11.902 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:11.902 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:11.902 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:11.902 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:11.903 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:11.898+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:11.916 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:24:11.917 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:11.917 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:11.941 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:11.941 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:11.962 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:11.962 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:11.986 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:12.004 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:12.000+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:12.005 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:12.006 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:12.030 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:12.030 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:12.052 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:12.053 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:12.053 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:12.053 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:12.053 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0 2024-04-26T02:24:12.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:12.076 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:12.076 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:12.082 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 34/31 ECSubWrite(tid=162, reqid=client.4589.0:23, at_version=0'0, trim_to=0'0, roll_forward_to=34'4))", 2024-04-26T02:24:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:02.042585+0000", 2024-04-26T02:24:12.083 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.037161992, 2024-04-26T02:24:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057700629999999998, 2024-04-26T02:24:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042585+0000", 2024-04-26T02:24:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042585+0000", 2024-04-26T02:24:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042586+0000", 2024-04-26T02:24:12.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.468e-06 2024-04-26T02:24:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042613+0000", 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7263999999999998e-05 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042633+0000", 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9860999999999998e-05 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042650+0000", 2024-04-26T02:24:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6452000000000001e-05 2024-04-26T02:24:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042804+0000", 2024-04-26T02:24:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015396299999999999 2024-04-26T02:24:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.042821+0000", 2024-04-26T02:24:12.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7329999999999998e-05 2024-04-26T02:24:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.048269+0000", 2024-04-26T02:24:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054483429999999996 2024-04-26T02:24:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.048355+0000", 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5382000000000003e-05 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 34/31 ECSubWrite(tid=7, reqid=client.4589.0:38, at_version=0'0, trim_to=0'0, roll_forward_to=34'4))", 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:02.046971+0000", 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.032775560999999, 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064074639999999999, 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.046971+0000", 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.046971+0000", 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.046972+0000", 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.181e-06 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.046986+0000", 2024-04-26T02:24:12.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3424000000000001e-05 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047004+0000", 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7941e-05 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047024+0000", 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0466e-05 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047099+0000", 2024-04-26T02:24:12.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4534000000000002e-05 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047106+0000", 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7309999999999993e-06 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053319+0000", 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062129150000000003 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053379+0000", 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9271999999999998e-05 2024-04-26T02:24:12.096 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 34/31 ECSubWrite(tid=6, reqid=client.4589.0:35, at_version=0'0, trim_to=0'0, roll_forward_to=34'2))", 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:02.047679+0000", 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.032068099, 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0056941049999999997, 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047679+0000", 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047679+0000", 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047686+0000", 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9840000000000004e-06 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047704+0000", 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8725000000000001e-05 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047731+0000", 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6859000000000002e-05 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047747+0000", 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5662999999999999e-05 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047843+0000", 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5649000000000005e-05 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.047855+0000", 2024-04-26T02:24:12.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2779000000000001e-05 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053335+0000", 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054799640000000004 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053373+0000", 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7481999999999998e-05 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.bs1 34/31 ECSubWrite(tid=9, reqid=client.4589.0:50, at_version=0'0, trim_to=0'0, roll_forward_to=34'6))", 2024-04-26T02:24:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:02.049319+0000", 2024-04-26T02:24:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.030428182, 2024-04-26T02:24:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072016370000000003, 2024-04-26T02:24:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.102 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049319+0000", 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049319+0000", 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049320+0000", 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.325e-06 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049334+0000", 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.432e-05 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049359+0000", 2024-04-26T02:24:12.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4583000000000002e-05 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049372+0000", 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2959000000000001e-05 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049503+0000", 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013149599999999999 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.049515+0000", 2024-04-26T02:24:12.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1644000000000001e-05 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.056351+0000", 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068365270000000002 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.056520+0000", 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016878300000000001 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.106 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 34/31 ECSubWrite(tid=8, reqid=client.4589.0:55, at_version=34'3, trim_to=0'0, roll_forward_to=34'2))", 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:02.053232+0000", 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.026515066, 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064992289999999996, 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053232+0000", 2024-04-26T02:24:12.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053232+0000", 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053233+0000", 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.004e-06 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053387+0000", 2024-04-26T02:24:12.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154606 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053403+0000", 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5427999999999999e-05 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053413+0000", 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.01e-05 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053505+0000", 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1952000000000003e-05 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.053520+0000", 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5021999999999999e-05 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.059682+0000", 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061621829999999999 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:02.059731+0000", 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8934000000000003e-05 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.0440136500000001, 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0094430320000000005, 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.111 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035735+0000", 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8330000000000001e-06 2024-04-26T02:24:12.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035787+0000", 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2111000000000003e-05 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035818+0000", 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0599000000000003e-05 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035841+0000", 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2889000000000001e-05 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036181+0000", 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340057 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036195+0000", 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4769e-05 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045085+0000", 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088895439999999992 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045176+0000", 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1230000000000006e-05 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.0415847329999997, 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095415010000000008, 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.115 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038163+0000", 2024-04-26T02:24:12.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7999999999999995e-07 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038217+0000", 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4588e-05 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038250+0000", 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2628e-05 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038274+0000", 2024-04-26T02:24:12.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4256e-05 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038532+0000", 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025780300000000003 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038556+0000", 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3811999999999998e-05 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047633+0000", 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090777800000000006 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047704+0000", 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0054000000000004e-05 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.039196316, 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089888439999999993, 2024-04-26T02:24:12.119 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040551+0000", 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6199999999999999e-07 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040593+0000", 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2224000000000001e-05 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040614+0000", 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0746000000000001e-05 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040630+0000", 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6441999999999999e-05 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041176+0000", 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00054610900000000003 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041224+0000", 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7712e-05 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049439+0000", 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082147729999999999 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049539+0000", 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100476 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:12.123 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.0390826860000004, 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087839709999999998, 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040665+0000", 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3399999999999998e-07 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040718+0000", 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2923999999999997e-05 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040748+0000", 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0709e-05 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040771+0000", 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2636000000000001e-05 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041006+0000", 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023521999999999999 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041030+0000", 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3736000000000001e-05 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049357+0000", 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083271030000000006 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049448+0000", 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909000000000007e-05 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:12.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.0390794159999999, 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012142201, 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040668+0000", 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2699999999999998e-07 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040700+0000", 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1668999999999998e-05 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040714+0000", 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4517e-05 2024-04-26T02:24:12.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040730+0000", 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6030000000000001e-05 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046667+0000", 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059366619999999997 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046693+0000", 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5769e-05 2024-04-26T02:24:12.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052718+0000", 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060254139999999998 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052810+0000", 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1312999999999998e-05 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.131 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.048020+0000", 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.0317265009999996, 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0076681650000000002, 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048020+0000", 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048020+0000", 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048021+0000", 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.153e-06 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048065+0000", 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3198000000000002e-05 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048090+0000", 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5469e-05 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048110+0000", 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9882999999999999e-05 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049070+0000", 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00096005799999999996 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049092+0000", 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2249e-05 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.055465+0000", 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063729310000000001 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.055688+0000", 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000223224 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.035925+0000", 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.043821576, 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062601219999999999, 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.035925+0000", 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.035925+0000", 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.035927+0000", 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.86e-06 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.035986+0000", 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8752000000000003e-05 2024-04-26T02:24:12.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036044+0000", 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8186999999999997e-05 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036066+0000", 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1863000000000001e-05 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036330+0000", 2024-04-26T02:24:12.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026448200000000002 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.036353+0000", 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3073000000000001e-05 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042106+0000", 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057524050000000004 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042185+0000", 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9499999999999994e-05 2024-04-26T02:24:12.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:258 3.6s0 3:67e91997:::smithi17529564-21:head [append 0~442368] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.118330+0000", 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9614170500000001, 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007299743, 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.140 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 258 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.118330+0000", 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.118330+0000", 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.118332+0000", 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4420000000000001e-06 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.118634+0000", 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030204100000000002 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.118661+0000", 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6495e-05 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.118674+0000", 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3263e-05 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.118833+0000", 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015924799999999999 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.119086+0000", 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000252568 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.121938+0000", 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028524980000000002 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.124026+0000", 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020877449999999998 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.125511+0000", 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014845570000000001 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.125629+0000", 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118886 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:259 3.6s0 3:67e91997:::smithi17529564-21:head [append 0~720896] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.126801+0000", 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9529457049999999, 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061853150000000003, 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:12.145 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 259 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.126801+0000", 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.126801+0000", 2024-04-26T02:24:12.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.126802+0000", 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2449999999999999e-06 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127122+0000", 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032007999999999998 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127135+0000", 2024-04-26T02:24:12.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2508e-05 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127141+0000", 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5679999999999996e-06 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127193+0000", 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1280999999999999e-05 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011348100000000001 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.128031+0000", 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00072457700000000001 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.130901+0000", 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002870657 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.132918+0000", 2024-04-26T02:24:12.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020169789999999999 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.132986+0000", 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7939000000000001e-05 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:260 3.6s0 3:67e91997:::smithi17529564-21:head [append 0~49152] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127229+0000", 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9525173759999999, 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070338329999999998, 2024-04-26T02:24:12.150 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 260 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127229+0000", 2024-04-26T02:24:12.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127229+0000", 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127230+0000", 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4300000000000002e-07 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127280+0000", 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9514000000000001e-05 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127288+0000", 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5599999999999994e-06 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127295+0000", 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6549999999999998e-06 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.128724+0000", 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001429507 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.128812+0000", 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7491000000000006e-05 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129201+0000", 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00038868600000000001 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.131752+0000", 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025518699999999999 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.134193+0000", 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024405120000000001 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.134263+0000", 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0295000000000004e-05 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:261 3.6s0 3:67e91997:::smithi17529564-21:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9524405150000002, 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097788909999999996, 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 261 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.156 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127307+0000", 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2399999999999998e-07 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127310+0000", 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.021e-06 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127316+0000", 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9309999999999996e-06 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127321+0000", 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2020000000000003e-06 2024-04-26T02:24:12.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129502+0000", 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002180586 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129561+0000", 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9558000000000001e-05 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129830+0000", 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268829 2024-04-26T02:24:12.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.131759+0000", 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019285280000000001 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.136744+0000", 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049853220000000004 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.137085+0000", 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034129000000000001 2024-04-26T02:24:12.160 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:262 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9524066520000001, 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013830606, 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.161 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 262 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127341+0000", 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5300000000000004e-07 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127343+0000", 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4399999999999999e-06 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127349+0000", 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2369999999999997e-06 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127356+0000", 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1600000000000001e-06 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129990+0000", 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026331509999999998 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.130041+0000", 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1842999999999998e-05 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138025+0000", 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079837410000000008 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138259+0000", 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023420799999999999 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.141171+0000", 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029112729999999998 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:273 3.6s0 3:687a1e37:::smithi17529564-28:head [append 0~770048] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9252586389999999, 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086583819999999992, 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 273 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.166 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154491+0000", 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.717e-06 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155144+0000", 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065291999999999998 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155176+0000", 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2135000000000003e-05 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155197+0000", 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1146e-05 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155809+0000", 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00061185199999999997 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155971+0000", 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016195700000000001 2024-04-26T02:24:12.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158718+0000", 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002747453 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161464+0000", 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00274567 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163030+0000", 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001566121 2024-04-26T02:24:12.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163146+0000", 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011641099999999999 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:274 3.6s0 3:687a1e37:::smithi17529564-28:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9245014459999998, 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090195850000000001, 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.171 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 274 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155247+0000", 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4300000000000001e-06 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155253+0000", 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0560000000000001e-06 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155265+0000", 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2407e-05 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155275+0000", 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0149000000000001e-05 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160233+0000", 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049580379999999997 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160381+0000", 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000147207 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160878+0000", 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049781399999999996 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163164+0000", 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002285881 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:12.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164154+0000", 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00098951799999999999 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164265+0000", 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000111085 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:275 3.6s0 3:687a1e37:::smithi17529564-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.9244314949999999, 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011804706999999999, 2024-04-26T02:24:12.176 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 275 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155316+0000", 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2299999999999999e-07 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:12.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155320+0000", 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.49e-06 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155331+0000", 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.136e-05 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155343+0000", 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2369e-05 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162104+0000", 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067605010000000004 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162345+0000", 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000240669 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164877+0000", 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002532075 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165083+0000", 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020615600000000001 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167120+0000", 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020371640000000002 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:12.181 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:12.182 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-04-26T02:24:12.183 INFO:tasks.rados.rados.0.smithi175.stdout:115: done (1 left) 2024-04-26T02:24:12.183 INFO:tasks.rados.rados.0.smithi175.stdout:116: done (0 left) 2024-04-26T02:24:12.183 INFO:tasks.rados.rados.0.smithi175.stdout:117: delete oid 35 current snap is 6 2024-04-26T02:24:12.183 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:12.184 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:12.185 INFO:tasks.rados.rados.0.smithi175.stdout:117: done (0 left) 2024-04-26T02:24:12.185 INFO:tasks.rados.rados.0.smithi175.stdout:118: snap_create 2024-04-26T02:24:12.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:24:12.186 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:12.178+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:12.186 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:12.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:12.124+0000 7f097a486640 0 -- 172.21.15.59:0/4192719857 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f0974221400 msgr2=0x7f0974221860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:12.187 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:12.190 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:12.284 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:12.280+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:12.351 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:12.351 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:12.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:12.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:24:12.385 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-04-26T02:24:12.088595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35406368,"num_objects":49,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":280,"num_read_kb":10406,"num_write":428,"num_write_kb":40628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":398,"ondisk_log_size":398,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":500212,"kb_used_data":63716,"kb_used_omap":24,"kb_used_meta":436263,"kb_avail":1509449228,"statfs":{"total":1546188226560,"available":1545676009472,"internally_reserved":0,"allocated":65245184,"data_stored":61633022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":446733395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12353536,"num_objects":-3,"num_object_clones":-1,"num_object_copies":-21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3,"num_whiteouts":0,"num_read":34,"num_read_kb":7642,"num_write":93,"num_write_kb":14896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.036803"},"pg_stats":[{"pgid":"3.f","version":"38'14","reported_seq":71,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.080168+0000","last_change":"2024-04-26T02:24:08.081163+0000","last_active":"2024-04-26T02:24:08.080168+0000","last_peered":"2024-04-26T02:24:08.080168+0000","last_clean":"2024-04-26T02:24:08.080168+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:08.080168+0000","last_undegraded":"2024-04-26T02:24:08.080168+0000","last_fullsized":"2024-04-26T02:24:08.080168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:20.989030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002638034,"stat_sum":{"num_bytes":1671168,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":13,"num_read_kb":2165,"num_write":9,"num_write_kb":2192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"3.e","version":"42'14","reported_seq":83,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.483020+0000","last_change":"2024-04-26T02:24:10.079195+0000","last_active":"2024-04-26T02:24:11.483020+0000","last_peered":"2024-04-26T02:24:11.483020+0000","last_clean":"2024-04-26T02:24:11.483020+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:11.483020+0000","last_undegraded":"2024-04-26T02:24:11.483020+0000","last_fullsized":"2024-04-26T02:24:11.483020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:18.207653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017336960000000001,"stat_sum":{"num_bytes":507904,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":1004,"num_write":27,"num_write_kb":864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.d","version":"40'26","reported_seq":82,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.118558+0000","last_change":"2024-04-26T02:24:08.111892+0000","last_active":"2024-04-26T02:24:08.118558+0000","last_peered":"2024-04-26T02:24:08.118558+0000","last_clean":"2024-04-26T02:24:08.118558+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:08.118558+0000","last_undegraded":"2024-04-26T02:24:08.118558+0000","last_fullsized":"2024-04-26T02:24:08.118558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.316144+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.041717197999999997,"stat_sum":{"num_bytes":4898816,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8,"num_write":20,"num_write_kb":5264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"3.c","version":"38'33","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.156916+0000","last_change":"2024-04-26T02:24:08.081074+0000","last_active":"2024-04-26T02:24:08.156916+0000","last_peered":"2024-04-26T02:24:08.156916+0000","last_clean":"2024-04-26T02:24:08.156916+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:08.156916+0000","last_undegraded":"2024-04-26T02:24:08.156916+0000","last_fullsized":"2024-04-26T02:24:08.156916+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:20.877693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031244850000000002,"stat_sum":{"num_bytes":5144576,"num_objects":8,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":4475,"num_write":22,"num_write_kb":5024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"3.b","version":"42'7","reported_seq":74,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.088360+0000","last_change":"2024-04-26T02:24:10.076180+0000","last_active":"2024-04-26T02:24:11.088360+0000","last_peered":"2024-04-26T02:24:11.088360+0000","last_clean":"2024-04-26T02:24:11.088360+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:11.088360+0000","last_undegraded":"2024-04-26T02:24:11.088360+0000","last_fullsized":"2024-04-26T02:24:11.088360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.905300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001340122,"stat_sum":{"num_bytes":196608,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":7,"num_write_kb":464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.a","version":"38'21","reported_seq":72,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.070555+0000","last_change":"2024-04-26T02:24:08.071497+0000","last_active":"2024-04-26T02:24:08.070555+0000","last_peered":"2024-04-26T02:24:08.070555+0000","last_clean":"2024-04-26T02:24:08.070555+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:08.070555+0000","last_undegraded":"2024-04-26T02:24:08.070555+0000","last_fullsized":"2024-04-26T02:24:08.070555+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.831020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001328341,"stat_sum":{"num_bytes":1916928,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":4,"num_write":31,"num_write_kb":1872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"3.9","version":"40'23","reported_seq":93,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.482894+0000","last_change":"2024-04-26T02:24:10.079129+0000","last_active":"2024-04-26T02:24:11.482894+0000","last_peered":"2024-04-26T02:24:11.482894+0000","last_clean":"2024-04-26T02:24:11.482894+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:11.482894+0000","last_undegraded":"2024-04-26T02:24:11.482894+0000","last_fullsized":"2024-04-26T02:24:11.482894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.580399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022026010000000002,"stat_sum":{"num_bytes":4243456,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":247,"num_write":15,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.8","version":"38'17","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.435199+0000","last_change":"2024-04-26T02:24:10.096362+0000","last_active":"2024-04-26T02:24:11.435199+0000","last_peered":"2024-04-26T02:24:11.435199+0000","last_clean":"2024-04-26T02:24:11.435199+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:11.435199+0000","last_undegraded":"2024-04-26T02:24:11.435199+0000","last_fullsized":"2024-04-26T02:24:11.435199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.088251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00139719,"stat_sum":{"num_bytes":2490368,"num_objects":4,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"1.0","version":"26'157","reported_seq":243,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.435279+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:11.435279+0000","last_peered":"2024-04-26T02:24:11.435279+0000","last_clean":"2024-04-26T02:24:11.435279+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:11.435279+0000","last_undegraded":"2024-04-26T02:24:11.435279+0000","last_fullsized":"2024-04-26T02:24:11.435279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.087919+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:11.087919+0000","last_peered":"2024-04-26T02:24:11.087919+0000","last_clean":"2024-04-26T02:24:11.087919+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:11.087919+0000","last_undegraded":"2024-04-26T02:24:11.087919+0000","last_fullsized":"2024-04-26T02:24:11.087919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"34'4","reported_seq":69,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.088072+0000","last_change":"2024-04-26T02:24:10.090318+0000","last_active":"2024-04-26T02:24:11.088072+0000","last_peered":"2024-04-26T02:24:11.088072+0000","last_clean":"2024-04-26T02:24:11.088072+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:11.088072+0000","last_undegraded":"2024-04-26T02:24:11.088072+0000","last_fullsized":"2024-04-26T02:24:11.088072+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:24.951296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011128889999999999,"stat_sum":{"num_bytes":688128,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.056643+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:08.056643+0000","last_peered":"2024-04-26T02:24:08.056643+0000","last_clean":"2024-04-26T02:24:08.056643+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:08.056643+0000","last_undegraded":"2024-04-26T02:24:08.056643+0000","last_fullsized":"2024-04-26T02:24:08.056643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"42'12","reported_seq":77,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T02:24:10.178066+0000","last_change":"2024-04-26T02:24:10.138157+0000","last_active":"2024-04-26T02:24:10.178066+0000","last_peered":"2024-04-26T02:24:10.178066+0000","last_clean":"2024-04-26T02:24:10.178066+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:10.178066+0000","last_undegraded":"2024-04-26T02:24:10.178066+0000","last_fullsized":"2024-04-26T02:24:10.178066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.338504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088342499999999997,"stat_sum":{"num_bytes":1622016,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":12,"num_write_kb":2080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.087806+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:11.087806+0000","last_peered":"2024-04-26T02:24:11.087806+0000","last_clean":"2024-04-26T02:24:11.087806+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:11.087806+0000","last_undegraded":"2024-04-26T02:24:11.087806+0000","last_fullsized":"2024-04-26T02:24:11.087806+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"40'16","reported_seq":83,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T02:24:10.095183+0000","last_change":"2024-04-26T02:24:10.096140+0000","last_active":"2024-04-26T02:24:10.095183+0000","last_peered":"2024-04-26T02:24:10.095183+0000","last_clean":"2024-04-26T02:24:10.095183+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:10.095183+0000","last_undegraded":"2024-04-26T02:24:10.095183+0000","last_fullsized":"2024-04-26T02:24:10.095183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.039928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001429086,"stat_sum":{"num_bytes":3653632,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2358,"num_write":13,"num_write_kb":3568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.056925+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:08.056925+0000","last_peered":"2024-04-26T02:24:08.056925+0000","last_clean":"2024-04-26T02:24:08.056925+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:08.056925+0000","last_undegraded":"2024-04-26T02:24:08.056925+0000","last_fullsized":"2024-04-26T02:24:08.056925+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T02:24:10.097761+0000","last_change":"2024-04-26T02:24:10.098440+0000","last_active":"2024-04-26T02:24:10.097761+0000","last_peered":"2024-04-26T02:24:10.097761+0000","last_clean":"2024-04-26T02:24:10.097761+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:10.097761+0000","last_undegraded":"2024-04-26T02:24:10.097761+0000","last_fullsized":"2024-04-26T02:24:10.097761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:02.499488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001131614,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"3.5","version":"38'31","reported_seq":82,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.057598+0000","last_change":"2024-04-26T02:24:08.058221+0000","last_active":"2024-04-26T02:24:08.057598+0000","last_peered":"2024-04-26T02:24:08.057598+0000","last_clean":"2024-04-26T02:24:08.057598+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:08.057598+0000","last_undegraded":"2024-04-26T02:24:08.057598+0000","last_fullsized":"2024-04-26T02:24:08.057598+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.740766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00095901600000000004,"stat_sum":{"num_bytes":3293184,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":35,"num_write_kb":3872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-26T02:24:10.137576+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:10.137576+0000","last_peered":"2024-04-26T02:24:10.137576+0000","last_clean":"2024-04-26T02:24:10.137576+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:10.137576+0000","last_undegraded":"2024-04-26T02:24:10.137576+0000","last_fullsized":"2024-04-26T02:24:10.137576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":63,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.088472+0000","last_change":"2024-04-26T02:24:10.078048+0000","last_active":"2024-04-26T02:24:11.088472+0000","last_peered":"2024-04-26T02:24:11.088472+0000","last_clean":"2024-04-26T02:24:11.088472+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:11.088472+0000","last_undegraded":"2024-04-26T02:24:11.088472+0000","last_fullsized":"2024-04-26T02:24:11.088472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.293186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021816420000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.087934+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:11.087934+0000","last_peered":"2024-04-26T02:24:11.087934+0000","last_clean":"2024-04-26T02:24:11.087934+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:11.087934+0000","last_undegraded":"2024-04-26T02:24:11.087934+0000","last_fullsized":"2024-04-26T02:24:11.087934+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"34'4","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-26T02:24:09.076560+0000","last_change":"2024-04-26T02:24:08.078004+0000","last_active":"2024-04-26T02:24:09.076560+0000","last_peered":"2024-04-26T02:24:09.076560+0000","last_clean":"2024-04-26T02:24:09.076560+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:09.076560+0000","last_undegraded":"2024-04-26T02:24:09.076560+0000","last_fullsized":"2024-04-26T02:24:09.076560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.078477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001160276,"stat_sum":{"num_bytes":770048,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":4,"num_write_kb":752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"3"}]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.497730+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:11.497730+0000","last_peered":"2024-04-26T02:24:11.497730+0000","last_clean":"2024-04-26T02:24:11.497730+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:11.497730+0000","last_undegraded":"2024-04-26T02:24:11.497730+0000","last_fullsized":"2024-04-26T02:24:11.497730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"42'19","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-26T02:24:11.497852+0000","last_change":"2024-04-26T02:24:10.079503+0000","last_active":"2024-04-26T02:24:11.497852+0000","last_peered":"2024-04-26T02:24:11.497852+0000","last_clean":"2024-04-26T02:24:11.497852+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:11.497852+0000","last_undegraded":"2024-04-26T02:24:11.497852+0000","last_fullsized":"2024-04-26T02:24:11.497852+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:07.732275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001938344,"stat_sum":{"num_bytes":3719168,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":14,"num_write_kb":3968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"4"}]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-26T02:24:08.056987+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:08.056987+0000","last_peered":"2024-04-26T02:24:08.056987+0000","last_clean":"2024-04-26T02:24:08.056987+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:08.056987+0000","last_undegraded":"2024-04-26T02:24:08.056987+0000","last_fullsized":"2024-04-26T02:24:08.056987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":34816000,"num_objects":47,"num_object_clones":0,"num_object_copies":329,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":144,"num_read_kb":10288,"num_write":225,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57905152,"data_stored":57905152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241,"ondisk_log_size":241,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215114,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30304,"kb_used_data":3284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341536,"statfs":{"total":96636764160,"available":96605732864,"internally_reserved":0,"allocated":3362816,"data_stored":3272834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215111,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30132,"kb_used_data":3112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341708,"statfs":{"total":96636764160,"available":96605908992,"internally_reserved":0,"allocated":3186688,"data_stored":2939067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215111,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31356,"kb_used_data":4336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340484,"statfs":{"total":96636764160,"available":96604655616,"internally_reserved":0,"allocated":4440064,"data_stored":4192443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313223,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":4428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":4534272,"data_stored":4280508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280519,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30012,"kb_used_data":2992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341828,"statfs":{"total":96636764160,"available":96606031872,"internally_reserved":0,"allocated":3063808,"data_stored":2803957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280520,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29080,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342760,"statfs":{"total":96636764160,"available":96606986240,"internally_reserved":0,"allocated":2113536,"data_stored":1853685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280521,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":5700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":5836800,"data_stored":5576949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280519,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30984,"kb_used_data":3964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340856,"statfs":{"total":96636764160,"available":96605036544,"internally_reserved":0,"allocated":4059136,"data_stored":3799285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280521,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31544,"kb_used_data":4524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340296,"statfs":{"total":96636764160,"available":96604463104,"internally_reserved":0,"allocated":4632576,"data_stored":4372725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280519,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":4792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":4907008,"data_stored":4647157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280519,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34164,"kb_used_data":2984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337676,"statfs":{"total":96636764160,"available":96601780224,"internally_reserved":0,"allocated":3055616,"data_stored":2792213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280520,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31128,"kb_used_data":4100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340712,"statfs":{"total":96636764160,"available":96604889088,"internally_reserved":0,"allocated":4198400,"data_stored":3934997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280519,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30956,"kb_used_data":3936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340884,"statfs":{"total":96636764160,"available":96605065216,"internally_reserved":0,"allocated":4030464,"data_stored":3770613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280520,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":5108,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":5230592,"data_stored":4964598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280520,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30576,"kb_used_data":3556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94341264,"statfs":{"total":96636764160,"available":96605454336,"internally_reserved":0,"allocated":3641344,"data_stored":3381493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215111,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":4952064,"data_stored":5050498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5287936,"data_stored":5287936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5316608,"data_stored":5316608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4112384,"data_stored":4112384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4030464,"data_stored":4030464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4182016,"data_stored":4182016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2002944,"data_stored":2002944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3145728,"data_stored":3145728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3510272,"data_stored":3510272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":2699264,"data_stored":2699264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4694016,"data_stored":4694016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":2863104,"data_stored":2863104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":1593344,"data_stored":1593344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":3420160,"data_stored":3420160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":3121152,"data_stored":3121152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":3538944,"data_stored":3538944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":4386816,"data_stored":4386816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:12.386 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pgp_num 16 2024-04-26T02:24:12.387 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:12.382+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:12.459 INFO:tasks.rados.rados.0.smithi175.stdout:118: done (0 left) 2024-04-26T02:24:12.459 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 6 current snap is 7 2024-04-26T02:24:12.459 INFO:tasks.rados.rados.0.smithi175.stdout:119: seq_num 80 ranges {1277952=589824,1867776=573440,2441216=196608} 2024-04-26T02:24:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:119: writing smithi17529564-6 from 1277952 to 1867776 tid 1 2024-04-26T02:24:12.486 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:12.482+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:12.487 INFO:tasks.rados.rados.0.smithi175.stdout:119: writing smithi17529564-6 from 1867776 to 2441216 tid 2 2024-04-26T02:24:12.490 INFO:tasks.rados.rados.0.smithi175.stdout:119: writing smithi17529564-6 from 2441216 to 2637824 tid 3 2024-04-26T02:24:12.490 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 4 current snap is 7 2024-04-26T02:24:12.491 INFO:tasks.rados.rados.0.smithi175.stdout:120: seq_num 81 ranges {65536=606208,671744=720896,1392640=49152} 2024-04-26T02:24:12.500 INFO:tasks.rados.rados.0.smithi175.stdout:120: writing smithi17529564-4 from 65536 to 671744 tid 1 2024-04-26T02:24:12.511 INFO:tasks.rados.rados.0.smithi175.stdout:120: writing smithi17529564-4 from 671744 to 1392640 tid 2 2024-04-26T02:24:12.512 INFO:tasks.rados.rados.0.smithi175.stdout:120: writing smithi17529564-4 from 1392640 to 1441792 tid 3 2024-04-26T02:24:12.512 INFO:tasks.rados.rados.0.smithi175.stdout:121: snap_create 2024-04-26T02:24:12.512 INFO:tasks.rados.rados.0.smithi175.stdout:119: finishing write tid 1 to smithi17529564-6 2024-04-26T02:24:12.512 INFO:tasks.rados.rados.0.smithi175.stdout:119: finishing write tid 2 to smithi17529564-6 2024-04-26T02:24:12.512 INFO:tasks.rados.rados.0.smithi175.stdout:119: finishing write tid 3 to smithi17529564-6 2024-04-26T02:24:12.512 INFO:tasks.rados.rados.0.smithi175.stdout:119: finishing write tid 4 to smithi17529564-6 2024-04-26T02:24:12.515 INFO:tasks.rados.rados.0.smithi175.stdout:119: finishing write tid 5 to smithi17529564-6 2024-04-26T02:24:12.515 INFO:tasks.rados.rados.0.smithi175.stdout:119: oid 6 updating version 0 to 15 2024-04-26T02:24:12.515 INFO:tasks.rados.rados.0.smithi175.stdout:119: oid 6 updating version 15 to 17 2024-04-26T02:24:12.515 INFO:tasks.rados.rados.0.smithi175.stdout:119: oid 6 version 17 is already newer than 14 2024-04-26T02:24:12.516 INFO:tasks.rados.rados.0.smithi175.stdout:119: oid 6 version 17 is already newer than 16 2024-04-26T02:24:12.516 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 6 v 17 (ObjNum 80 snap 7 seq_num 80) dirty exists 2024-04-26T02:24:12.516 INFO:tasks.rados.rados.0.smithi175.stdout:119: left oid 6 (ObjNum 80 snap 7 seq_num 80) 2024-04-26T02:24:12.516 INFO:tasks.rados.rados.0.smithi175.stdout:120: finishing write tid 1 to smithi17529564-4 2024-04-26T02:24:12.518 INFO:tasks.rados.rados.0.smithi175.stdout:120: finishing write tid 2 to smithi17529564-4 2024-04-26T02:24:12.520 INFO:tasks.rados.rados.0.smithi175.stdout:120: finishing write tid 3 to smithi17529564-4 2024-04-26T02:24:12.520 INFO:tasks.rados.rados.0.smithi175.stdout:120: finishing write tid 4 to smithi17529564-4 2024-04-26T02:24:12.523 INFO:tasks.rados.rados.0.smithi175.stdout:120: finishing write tid 5 to smithi17529564-4 2024-04-26T02:24:12.523 INFO:tasks.rados.rados.0.smithi175.stdout:120: oid 4 updating version 0 to 26 2024-04-26T02:24:12.523 INFO:tasks.rados.rados.0.smithi175.stdout:120: oid 4 updating version 26 to 27 2024-04-26T02:24:12.523 INFO:tasks.rados.rados.0.smithi175.stdout:120: oid 4 version 27 is already newer than 25 2024-04-26T02:24:12.523 INFO:tasks.rados.rados.0.smithi175.stdout:120: oid 4 version 27 is already newer than 24 2024-04-26T02:24:12.523 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 27 (ObjNum 81 snap 7 seq_num 81) dirty exists 2024-04-26T02:24:12.523 INFO:tasks.rados.rados.0.smithi175.stdout:120: left oid 4 (ObjNum 81 snap 7 seq_num 81) 2024-04-26T02:24:12.556 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:12.556 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:12.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:24:12.587 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:12.584+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:12.688 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:12.684+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:12.691 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:12.691 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:12.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:24:12.789 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:12.784+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:12.835 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:12.835 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:12.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:24:12.890 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:12.886+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:12.990 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:12.990+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:13.022 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:13.022 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:13.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:24:13.091 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:13.088+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:13.162 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:13.163 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:13.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:24:13.220 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:13.216+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:13.294 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:13.288+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:13.349 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:13.349 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:13.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:24:13.394 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:13.392+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:13.454 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 3 pgp_num to 16 2024-04-26T02:24:13.461 INFO:tasks.rados.rados.0.smithi175.stdout:119: done (2 left) 2024-04-26T02:24:13.461 INFO:tasks.rados.rados.0.smithi175.stdout:120: done (1 left) 2024-04-26T02:24:13.461 INFO:tasks.rados.rados.0.smithi175.stdout:121: done (0 left) 2024-04-26T02:24:13.461 INFO:tasks.rados.rados.0.smithi175.stdout:122: read oid 2 snap -1 2024-04-26T02:24:13.461 INFO:tasks.rados.rados.0.smithi175.stdout:122: expect (ObjNum 1 snap 0 seq_num 1) 2024-04-26T02:24:13.461 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 28 current snap is 8 2024-04-26T02:24:13.461 INFO:tasks.rados.rados.0.smithi175.stdout:123: seq_num 82 ranges {1720320=622592,2342912=475136,2818048=294912} 2024-04-26T02:24:13.488 INFO:tasks.rados.rados.0.smithi175.stdout:123: writing smithi17529564-28 from 1720320 to 2342912 tid 1 2024-04-26T02:24:13.496 INFO:tasks.rados.rados.0.smithi175.stdout:123: writing smithi17529564-28 from 2342912 to 2818048 tid 2 2024-04-26T02:24:13.496 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:13.492+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:13.499 INFO:tasks.rados.rados.0.smithi175.stdout:123: writing smithi17529564-28 from 2818048 to 3112960 tid 3 2024-04-26T02:24:13.499 INFO:tasks.rados.rados.0.smithi175.stdout:124: rollback oid 3 current snap is 8 2024-04-26T02:24:13.499 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 3 to 5 2024-04-26T02:24:13.500 INFO:tasks.rados.rados.0.smithi175.stdout:122: expect (ObjNum 1 snap 0 seq_num 1) 2024-04-26T02:24:13.503 INFO:tasks.rados.rados.0.smithi175.stdout:122: done (2 left) 2024-04-26T02:24:13.503 INFO:tasks.rados.rados.0.smithi175.stdout:125: snap_remove snap 6 2024-04-26T02:24:13.539 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:13.540 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:13.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:24:13.599 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:13.596+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:13.680 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:13.680 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:13.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:24:13.698 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:13.694+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:13.799 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:13.796+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:13.866 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:13.866 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:13.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:24:13.900 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:13.896+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:14.001 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:13.996+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:14.009 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:14.009 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:14.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:24:14.102 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:14.100+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:14.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:24:14.191 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:14.195 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:14.196 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:14.202 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:14.198+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:14.213 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:24:14.303 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:14.302+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:14.341 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:14.341 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:14.345 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:14.345 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:14.360 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:24:14.361 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:14.361 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:14.381 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:14.381 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:14.402 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:14.402 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:14.407 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:14.404+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:14.422 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:14.423 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:14.441 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:14.441 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:14.463 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:14.463 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:125: done (2 left) 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:126: copy_from oid 29 from oid 23 current snap is 8 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:123: finishing write tid 1 to smithi17529564-28 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:123: finishing write tid 2 to smithi17529564-28 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:124: finishing rollback tid 0 to smithi17529564-3 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:123: finishing write tid 3 to smithi17529564-28 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:124: finishing rollback tid 1 to smithi17529564-3 2024-04-26T02:24:14.469 INFO:tasks.rados.rados.0.smithi175.stdout:123: finishing write tid 4 to smithi17529564-28 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:124: finishing rollback tid 2 to smithi17529564-3 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 3 v 8 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:123: finishing write tid 5 to smithi17529564-28 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:123: oid 28 updating version 0 to 23 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:123: oid 28 version 23 is already newer than 21 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:123: oid 28 updating version 23 to 24 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:123: oid 28 version 24 is already newer than 22 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 28 v 24 (ObjNum 82 snap 8 seq_num 82) dirty exists 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:123: left oid 28 (ObjNum 82 snap 8 seq_num 82) 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:123: done (2 left) 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:124: done (1 left) 2024-04-26T02:24:14.470 INFO:tasks.rados.rados.0.smithi175.stdout:127: snap_remove snap 5 2024-04-26T02:24:14.482 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:14.482 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:14.483 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:14.483 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:14.483 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:14.495 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:14.497 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:24:14.505 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:14.500+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:14.512 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:14.512 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:14.532 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:14.532 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:14.554 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:14.555 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:14.575 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:14.592 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:14.592 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:14.606 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:14.600+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:14.609 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:14.609 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:14.632 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:14.632 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:14.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:14.648+0000 7fc662d9d640 0 -- 172.21.15.59:0/939293475 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7fc6642234e0 msgr2=0x7fc6642258d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:14.654 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:14.654 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 37/31 ECSubWrite(tid=43, reqid=osd.12.0:43, at_version=37'17, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.028677+0000", 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6320502829999999, 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068193439999999998, 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.663 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028677+0000", 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028677+0000", 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028678+0000", 2024-04-26T02:24:14.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4700000000000001e-07 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028733+0000", 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5498999999999998e-05 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028759+0000", 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5503e-05 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028781+0000", 2024-04-26T02:24:14.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2317e-05 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028944+0000", 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016298800000000001 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028969+0000", 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5170000000000001e-05 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035396+0000", 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006427098 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035496+0000", 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100122 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.667 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 37/31 ECSubWrite(tid=44, reqid=osd.12.0:44, at_version=37'19, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.029993+0000", 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6307340559999997, 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006125419, 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.029993+0000", 2024-04-26T02:24:14.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.029993+0000", 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.029995+0000", 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9039999999999999e-06 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030086+0000", 2024-04-26T02:24:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0934999999999996e-05 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030127+0000", 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1103000000000003e-05 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030151+0000", 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3672999999999998e-05 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.031117+0000", 2024-04-26T02:24:14.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00096582799999999996 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.031142+0000", 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5761999999999998e-05 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036049+0000", 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049064879999999996 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036119+0000", 2024-04-26T02:24:14.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9726000000000003e-05 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.035501+0000", 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6252259230000003, 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0081818700000000008, 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035501+0000", 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035501+0000", 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035502+0000", 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6000000000000002e-07 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035579+0000", 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6536e-05 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035609+0000", 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0173000000000001e-05 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035628+0000", 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9525999999999999e-05 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035780+0000", 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015120500000000001 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035804+0000", 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4043e-05 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043585+0000", 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077808879999999997 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043683+0000", 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8639000000000002e-05 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 37/31 ECSubWrite(tid=45, reqid=osd.12.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.038059+0000", 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6226686689999994, 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056000429999999999, 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.676 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038059+0000", 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038059+0000", 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038060+0000", 2024-04-26T02:24:14.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.88e-06 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038090+0000", 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9133e-05 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038119+0000", 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.906e-05 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038139+0000", 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0496000000000002e-05 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038292+0000", 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000153282 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038318+0000", 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5113000000000002e-05 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043580+0000", 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052621300000000003 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.043659+0000", 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8949000000000006e-05 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.038696+0000", 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6220315270000008, 2024-04-26T02:24:14.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006334587, 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038696+0000", 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038696+0000", 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038697+0000", 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0240000000000001e-06 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038753+0000", 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6585000000000001e-05 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038778+0000", 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4519999999999999e-05 2024-04-26T02:24:14.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.038800+0000", 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2569999999999999e-05 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039007+0000", 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020635400000000001 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039031+0000", 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4303000000000001e-05 2024-04-26T02:24:14.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.044951+0000", 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.005920135 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045030+0000", 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9096000000000003e-05 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:14.684 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039673+0000", 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6210545090000004, 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0076317160000000002, 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039673+0000", 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039673+0000", 2024-04-26T02:24:14.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039675+0000", 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.756e-06 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039718+0000", 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3633000000000001e-05 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039738+0000", 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.969e-05 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039751+0000", 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.344e-05 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041214+0000", 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001462638 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041238+0000", 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3617000000000001e-05 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047207+0000", 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059689740000000002 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047304+0000", 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7967999999999994e-05 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 37/31 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.042301+0000", 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6184261590000002, 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049154209999999997, 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042301+0000", 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042301+0000", 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042303+0000", 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7460000000000001e-06 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042355+0000", 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2447000000000001e-05 2024-04-26T02:24:14.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042397+0000", 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1428999999999999e-05 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042417+0000", 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9933e-05 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042886+0000", 2024-04-26T02:24:14.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00046904800000000001 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042908+0000", 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1929999999999998e-05 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047120+0000", 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0042126990000000003 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047217+0000", 2024-04-26T02:24:14.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6188999999999997e-05 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 37/31 ECSubWrite(tid=65, reqid=osd.0.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.054906+0000", 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6058210689999992, 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0042048090000000003, 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054906+0000", 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054906+0000", 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054908+0000", 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.81e-06 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054941+0000", 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2700000000000002e-05 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054971+0000", 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0474999999999999e-05 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054990+0000", 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9094e-05 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055134+0000", 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014328799999999999 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055158+0000", 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4813000000000001e-05 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.058985+0000", 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038262109999999999 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.059111+0000", 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012641799999999999 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.6s6 37/31 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.056721+0000", 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.6040063359999994, 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048381149999999996, 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.697 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056721+0000", 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056721+0000", 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056722+0000", 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8400000000000003e-07 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056744+0000", 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2523000000000001e-05 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056769+0000", 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4802000000000001e-05 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.056789+0000", 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0434000000000001e-05 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057116+0000", 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032685199999999998 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057140+0000", 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.387e-05 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.061478+0000", 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043380709999999998 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.061559+0000", 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0778999999999993e-05 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 38/31 ECSubWrite(tid=66, reqid=osd.0.0:66, at_version=38'31, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.038643+0000", 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6220846649999991, 2024-04-26T02:24:14.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0064538010000000003, 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038643+0000", 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038643+0000", 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038644+0000", 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0359999999999999e-06 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038695+0000", 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1143000000000001e-05 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038721+0000", 2024-04-26T02:24:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6556000000000001e-05 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038744+0000", 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3e-05 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039276+0000", 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00053199200000000001 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039300+0000", 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3427000000000001e-05 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045019+0000", 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057195709999999997 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045096+0000", 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7076000000000005e-05 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.039350+0000", 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6213775590000008, 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073940389999999998, 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039350+0000", 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039350+0000", 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039351+0000", 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.66e-06 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039409+0000", 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7256000000000002e-05 2024-04-26T02:24:14.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039472+0000", 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2948999999999996e-05 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.039493+0000", 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1849999999999999e-05 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040117+0000", 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00062314200000000003 2024-04-26T02:24:14.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040142+0000", 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5236e-05 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046665+0000", 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065227169999999999 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046744+0000", 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9228999999999996e-05 2024-04-26T02:24:14.709 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6202305050000003, 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063562699999999998, 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040497+0000", 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4000000000000001e-07 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040551+0000", 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3547000000000001e-05 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040582+0000", 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0998999999999999e-05 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040601+0000", 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8957000000000002e-05 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040767+0000", 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016631400000000001 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040793+0000", 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5863e-05 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046775+0000", 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059822640000000002 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046853+0000", 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7686000000000001e-05 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.040709+0000", 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6200185109999996, 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059600859999999999, 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.714 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040709+0000", 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040709+0000", 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040710+0000", 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7999999999999993e-07 2024-04-26T02:24:14.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040752+0000", 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1763e-05 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040777+0000", 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5173000000000001e-05 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040795+0000", 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8346e-05 2024-04-26T02:24:14.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040939+0000", 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000144122 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.040954+0000", 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4800000000000001e-05 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046569+0000", 2024-04-26T02:24:14.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056153560000000002 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046669+0000", 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9545999999999999e-05 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.6s6 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.043883+0000", 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6168442810000005, 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065081770000000004, 2024-04-26T02:24:14.718 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043883+0000", 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043883+0000", 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043885+0000", 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.733e-06 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043910+0000", 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5616e-05 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043933+0000", 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2396999999999999e-05 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043947+0000", 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4357e-05 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044094+0000", 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000146864 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044118+0000", 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4012999999999999e-05 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050296+0000", 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061779319999999997 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050391+0000", 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5265000000000004e-05 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 38/31 ECSubWrite(tid=180, reqid=osd.6.0:180, at_version=38'17, trim_to=0'0, roll_forward_to=37'15))", 2024-04-26T02:24:14.722 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.045946+0000", 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6147809859999995, 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057735540000000002, 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045946+0000", 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045946+0000", 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045947+0000", 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0299999999999999e-07 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045994+0000", 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7443e-05 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046026+0000", 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1242999999999999e-05 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046078+0000", 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2246000000000001e-05 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046295+0000", 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021728399999999999 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046320+0000", 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4986000000000001e-05 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051622+0000", 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0053014000000000004 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051720+0000", 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8349000000000003e-05 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.057748+0000", 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6029788380000003, 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072443610000000004, 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057748+0000", 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057748+0000", 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057751+0000", 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.17e-06 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057779+0000", 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8552999999999999e-05 2024-04-26T02:24:14.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057815+0000", 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5892999999999997e-05 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057842+0000", 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6883e-05 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057997+0000", 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015542799999999999 2024-04-26T02:24:14.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058022+0000", 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4392999999999998e-05 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064892+0000", 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068701789999999997 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064993+0000", 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100862 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 38/31 ECSubWrite(tid=69, reqid=osd.0.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.057769+0000", 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6029587620000001, 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075345739999999996, 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057769+0000", 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057769+0000", 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057770+0000", 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057792+0000", 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.243e-05 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057816+0000", 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3963000000000001e-05 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057840+0000", 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4260000000000002e-05 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.057995+0000", 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015475800000000001 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058020+0000", 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4756000000000002e-05 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065172+0000", 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0071519890000000001 2024-04-26T02:24:14.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065303+0000", 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013120800000000001 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.058837+0000", 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.6018902399999995, 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065676170000000004, 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.735 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058837+0000", 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058837+0000", 2024-04-26T02:24:14.736 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058838+0000", 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.147e-06 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058900+0000", 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1902000000000005e-05 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058931+0000", 2024-04-26T02:24:14.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.116e-05 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058966+0000", 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4452999999999997e-05 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059116+0000", 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015071099999999999 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059141+0000", 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4736000000000002e-05 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065330+0000", 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061886019999999996 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.065405+0000", 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.4906000000000004e-05 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s5 42/31 ECSubWrite(tid=15, reqid=client.4589.0:276, at_version=42'9, trim_to=0'0, roll_forward_to=40'8))", 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:10.160410+0000", 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.5003169999999999, 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054111339999999997, 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.160410+0000", 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.740 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.160410+0000", 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.160411+0000", 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1999999999999999e-07 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163490+0000", 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0030788209999999998 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163517+0000", 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7086000000000001e-05 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163531+0000", 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4627000000000001e-05 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163696+0000", 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000165021 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163723+0000", 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6653e-05 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.165756+0000", 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020329559999999998 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.165821+0000", 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5350000000000003e-05 2024-04-26T02:24:14.743 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 42/31 ECSubWrite(tid=83, reqid=client.4589.0:286, at_version=42'15, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:10.183460+0000", 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.4772673489999999, 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037160259999999999, 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:14.744 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.183460+0000", 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.183460+0000", 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.183466+0000", 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9399999999999999e-06 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:14.745 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.184546+0000", 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010803099999999999 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.184586+0000", 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0136000000000003e-05 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.184608+0000", 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1532999999999999e-05 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:14.746 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.184776+0000", 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016862800000000001 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.184801+0000", 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4216999999999999e-05 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.187074+0000", 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022735530000000002 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:14.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.187176+0000", 2024-04-26T02:24:14.748 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101709 2024-04-26T02:24:14.748 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.748 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.748 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.748 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:14.748 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:14.748 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:14.750 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:14.744+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:14.750 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:24:14.850 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:14.844+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:14.921 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:14.921 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:14.921 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:14.921 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:14.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:24:14.952 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:14.952+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:15.053 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:15.048+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:15.100 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:15.101 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:15.101 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:15.115 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:24:15.159 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:15.156+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:15.255 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:15.252+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:15.286 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:15.286 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:15.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:15.286 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:15.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.286 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:22 1.0 e24/23 1:30306672:devicehealth::main.db.0000000000000000:head v 24'12, mlcod=24'8)", 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.034815+0000", 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 27.248382652, 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046323960000000004, 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034815+0000", 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034815+0000", 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034816+0000", 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1599999999999999e-06 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034826+0000", 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7729999999999994e-06 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034843+0000", 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6977e-05 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034854+0000", 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1353e-05 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034940+0000", 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6111000000000003e-05 2024-04-26T02:24:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.034976+0000", 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5533e-05 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.039366+0000", 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043904030000000002 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.039447+0000", 2024-04-26T02:24:15.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1086000000000003e-05 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:156 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'110, mlcod=24'105)", 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.652493+0000", 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.630704628, 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0044582759999999997, 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.652493+0000", 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.652493+0000", 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.652494+0000", 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9399999999999993e-07 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.652501+0000", 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5889999999999997e-06 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.652516+0000", 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4606999999999999e-05 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.652526+0000", 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5429999999999999e-06 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653075+0000", 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00054900100000000002 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653124+0000", 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9701999999999999e-05 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656855+0000", 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037306779999999999 2024-04-26T02:24:15.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656951+0000", 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6162000000000005e-05 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:157 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'111, mlcod=24'105)", 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.653134+0000", 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.630063154999998, 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056202459999999997, 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.295 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653134+0000", 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653134+0000", 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653136+0000", 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.73e-06 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653148+0000", 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1763000000000001e-05 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653170+0000", 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2665999999999999e-05 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653184+0000", 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3077e-05 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653937+0000", 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00075335400000000002 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653967+0000", 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9733000000000001e-05 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658661+0000", 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046944309999999998 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658755+0000", 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3492000000000005e-05 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:158 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'112, mlcod=24'106)", 2024-04-26T02:24:15.299 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.653857+0000", 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.629340367000001, 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049776400000000002, 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653857+0000", 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653857+0000", 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653859+0000", 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5600000000000001e-06 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653923+0000", 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4671999999999993e-05 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653946+0000", 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2422999999999999e-05 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653959+0000", 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3020000000000001e-05 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654427+0000", 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000467925 2024-04-26T02:24:15.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654475+0000", 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8588999999999998e-05 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658761+0000", 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0042859150000000004 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658835+0000", 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3535999999999995e-05 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:159 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'113, mlcod=24'106)", 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.654478+0000", 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.628719398000001, 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0044391789999999997, 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654478+0000", 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654478+0000", 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654480+0000", 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.663e-06 2024-04-26T02:24:15.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654492+0000", 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1877e-05 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654556+0000", 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4308999999999997e-05 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654572+0000", 2024-04-26T02:24:15.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6079999999999999e-05 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655541+0000", 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00096932699999999997 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655572+0000", 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0286000000000001e-05 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658840+0000", 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0032685520000000001 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658917+0000", 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7084999999999998e-05 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:160 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'114, mlcod=24'106)", 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.654930+0000", 2024-04-26T02:24:15.308 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.628267418, 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059506530000000002, 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654930+0000", 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654930+0000", 2024-04-26T02:24:15.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654931+0000", 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.15e-06 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654942+0000", 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0739e-05 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654956+0000", 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4503e-05 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654966+0000", 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4800000000000007e-06 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656141+0000", 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001175557 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656198+0000", 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6703000000000002e-05 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.660785+0000", 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045868630000000001 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.660881+0000", 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5657999999999998e-05 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.312 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:161 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'115, mlcod=24'108)", 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.655854+0000", 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.627343668000002, 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0051036049999999998, 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655854+0000", 2024-04-26T02:24:15.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655854+0000", 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655855+0000", 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.544e-06 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655911+0000", 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6168999999999997e-05 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655934+0000", 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2495999999999999e-05 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.655947+0000", 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3370000000000001e-05 2024-04-26T02:24:15.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.657035+0000", 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001087452 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.657077+0000", 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.2432999999999998e-05 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.660888+0000", 2024-04-26T02:24:15.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003810726 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.660957+0000", 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9414999999999999e-05 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:162 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'116, mlcod=24'108)", 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.656385+0000", 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.626812116, 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046551680000000003, 2024-04-26T02:24:15.317 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656385+0000", 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656385+0000", 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656386+0000", 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0729999999999999e-06 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656395+0000", 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8230000000000001e-06 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656409+0000", 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4087000000000001e-05 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.319 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656418+0000", 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1600000000000004e-06 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.657956+0000", 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001537344 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658010+0000", 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3875000000000002e-05 2024-04-26T02:24:15.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.660967+0000", 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029574110000000001 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.661041+0000", 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3394999999999998e-05 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:166 1.0 e24/23 1:30306672:devicehealth::main.db.0000000000000000:head v 24'120, mlcod=24'118)", 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.663788+0000", 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.619409623999999, 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046161730000000003, 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.663788+0000", 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.663788+0000", 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.663790+0000", 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8369999999999999e-06 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.663862+0000", 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1884999999999994e-05 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.663897+0000", 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5417000000000003e-05 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.663919+0000", 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1948999999999999e-05 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.664065+0000", 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000145668 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.664125+0000", 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0405999999999997e-05 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.668278+0000", 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041528329999999999 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.668404+0000", 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012617800000000001 2024-04-26T02:24:15.325 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:204 1.0 e26/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 26'150, mlcod=24'145)", 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:50.795816+0000", 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 24.487381394, 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0051234920000000003, 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.326 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.795816+0000", 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.795816+0000", 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.795818+0000", 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5370000000000001e-06 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.795831+0000", 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3856000000000001e-05 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.795859+0000", 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7385999999999998e-05 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.795879+0000", 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0360000000000002e-05 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.795997+0000", 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011779500000000001 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.796029+0000", 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1615999999999997e-05 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.800840+0000", 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004810964 2024-04-26T02:24:15.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:50.800940+0000", 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9977999999999997e-05 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.033981+0000", 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.249216667000001, 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057967230000000002, 2024-04-26T02:24:15.330 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033981+0000", 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033981+0000", 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033983+0000", 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.99e-06 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034039+0000", 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6436e-05 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034073+0000", 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4233000000000002e-05 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034097+0000", 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3249999999999999e-05 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034239+0000", 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000142368 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034261+0000", 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2223000000000001e-05 2024-04-26T02:24:15.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039705+0000", 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054435339999999999 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039778+0000", 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2688999999999995e-05 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.334 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.036990+0000", 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.246207212, 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0048714420000000001, 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036990+0000", 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036990+0000", 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036991+0000", 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1299999999999999e-07 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.037056+0000", 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5005999999999994e-05 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.037096+0000", 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0315999999999998e-05 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.037122+0000", 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5227000000000001e-05 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.037425+0000", 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030338899999999999 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.037455+0000", 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9810000000000001e-05 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041766+0000", 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043114579999999998 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041862+0000", 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5523e-05 2024-04-26T02:24:15.338 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 37/31 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.042348+0000", 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.24084935, 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045257159999999999, 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042348+0000", 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042348+0000", 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042349+0000", 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042402+0000", 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3248999999999998e-05 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042433+0000", 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0657000000000001e-05 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042456+0000", 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2858999999999999e-05 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042737+0000", 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028096000000000002 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042760+0000", 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3107000000000001e-05 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.046808+0000", 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0040477849999999999 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.046874+0000", 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6298999999999997e-05 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 37/31 ECSubWrite(tid=179, reqid=osd.6.0:178, at_version=0'0, trim_to=0'0, roll_forward_to=37'15))", 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.049334+0000", 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.233863136, 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045796659999999996, 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.343 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049334+0000", 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049334+0000", 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049336+0000", 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6899999999999999e-06 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049373+0000", 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7255999999999997e-05 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049407+0000", 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3686999999999998e-05 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049441+0000", 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4128999999999998e-05 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049708+0000", 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026670399999999999 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.049730+0000", 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1783000000000001e-05 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053818+0000", 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0040887950000000001 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053914+0000", 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5622e-05 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=35, reqid=osd.8.0:35, at_version=38'27, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:15.347 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033061+0000", 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2501361029999991, 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045175409999999999, 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033061+0000", 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033061+0000", 2024-04-26T02:24:15.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033062+0000", 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8700000000000001e-07 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033101+0000", 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8865999999999997e-05 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033126+0000", 2024-04-26T02:24:15.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.531e-05 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033143+0000", 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7243000000000001e-05 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033335+0000", 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019159099999999999 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033368+0000", 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2756000000000003e-05 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.037475+0000", 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041072970000000002 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.037579+0000", 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104091 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2483280279999995, 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073503989999999996, 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034871+0000", 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6700000000000001e-06 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034923+0000", 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1613000000000002e-05 2024-04-26T02:24:15.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034958+0000", 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4913000000000003e-05 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034979+0000", 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1863000000000001e-05 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035130+0000", 2024-04-26T02:24:15.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150018 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035154+0000", 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4615999999999999e-05 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042120+0000", 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069656709999999997 2024-04-26T02:24:15.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042220+0000", 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100035 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=37, reqid=osd.8.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=38'29))", 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.054022+0000", 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2291751699999995, 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045555040000000002, 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.356 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054022+0000", 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054022+0000", 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054024+0000", 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.73e-06 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054056+0000", 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1529000000000003e-05 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054093+0000", 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7750000000000003e-05 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054116+0000", 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3088999999999999e-05 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054289+0000", 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000172831 2024-04-26T02:24:15.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054320+0000", 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0809999999999998e-05 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058486+0000", 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041656519999999997 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058578+0000", 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2113000000000004e-05 2024-04-26T02:24:15.360 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.055093+0000", 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2281044919999999, 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058012350000000001, 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055093+0000", 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055093+0000", 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055095+0000", 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.694e-06 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055123+0000", 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.845e-05 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055152+0000", 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8515000000000001e-05 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055173+0000", 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1007000000000001e-05 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.363 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055395+0000", 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000222227 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055430+0000", 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5432999999999998e-05 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060792+0000", 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0053617609999999996 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060894+0000", 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000102148 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=38, reqid=osd.8.0:38, at_version=38'31, trim_to=0'0, roll_forward_to=38'29))", 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.056285+0000", 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2269128810000005, 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046991200000000002, 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.365 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056285+0000", 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056285+0000", 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056286+0000", 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8029999999999999e-06 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056342+0000", 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5322999999999999e-05 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056373+0000", 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1118999999999998e-05 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056396+0000", 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3416000000000001e-05 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056579+0000", 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000183105 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.056602+0000", 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3129000000000002e-05 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060916+0000", 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004313908 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060984+0000", 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7317000000000006e-05 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:24:15.369 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2251686119999992, 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066527089999999997, 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058037+0000", 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2330000000000006e-06 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058090+0000", 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2769999999999998e-05 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058122+0000", 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2224999999999997e-05 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058146+0000", 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3924e-05 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058303+0000", 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000157078 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058328+0000", 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4485999999999999e-05 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064575+0000", 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062476040000000004 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064682+0000", 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000106389 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.373 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.374 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.374 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.374 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:15.375 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:24:15.376 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:15.372+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:15.473 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:24:15.476 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:15.472+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:15.482 INFO:tasks.rados.rados.0.smithi175.stdout:127: done (1 left) 2024-04-26T02:24:15.482 INFO:tasks.rados.rados.0.smithi175.stdout:128: rollback oid 31 current snap is 8 2024-04-26T02:24:15.483 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 31 to 4 2024-04-26T02:24:15.483 INFO:tasks.rados.rados.0.smithi175.stdout:126: finishing copy_from to smithi17529564-29 2024-04-26T02:24:15.483 INFO:tasks.rados.rados.0.smithi175.stdout:126: got expected ENOENT (src dne) 2024-04-26T02:24:15.483 INFO:tasks.rados.rados.0.smithi175.stdout:126: finishing copy_from racing read to smithi17529564-29 2024-04-26T02:24:15.483 INFO:tasks.rados.rados.0.smithi175.stdout:126: done (1 left) 2024-04-26T02:24:15.483 INFO:tasks.rados.rados.0.smithi175.stdout:129: setattr oid 39 current snap is 8 2024-04-26T02:24:15.485 INFO:tasks.rados.rados.0.smithi175.stdout:130: snap_create 2024-04-26T02:24:15.497 INFO:tasks.rados.rados.0.smithi175.stdout:128: finishing rollback tid 0 to smithi17529564-31 2024-04-26T02:24:15.498 INFO:tasks.rados.rados.0.smithi175.stdout:128: finishing rollback tid 1 to smithi17529564-31 2024-04-26T02:24:15.498 INFO:tasks.rados.rados.0.smithi175.stdout:128: finishing rollback tid 2 to smithi17529564-31 2024-04-26T02:24:15.499 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 31 v 24 (ObjNum 30 snap 0 seq_num 30) dirty exists 2024-04-26T02:24:15.503 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 39 v 19 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-04-26T02:24:15.510 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:15.510 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:15.511 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:15.511 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:15.527 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:24:15.577 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:15.574+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:15.649 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:15.649 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:15.649 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:15.649 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:15.649 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:15.666 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:24:15.678 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:15.674+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:15.780 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:15.776+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.746713443000001, 2024-04-26T02:24:15.789 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088739449999999994, 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.790 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0400000000000005e-07 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039284+0000", 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.4362000000000004e-05 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039325+0000", 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1119999999999999e-05 2024-04-26T02:24:15.791 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039356+0000", 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0911999999999998e-05 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039522+0000", 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016579799999999999 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039547+0000", 2024-04-26T02:24:15.792 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4927e-05 2024-04-26T02:24:15.793 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.793 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.793 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.793 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048026+0000", 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084799690000000004 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048083+0000", 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6053e-05 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.746509851999999, 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085876479999999998, 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039413+0000", 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.037e-06 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039457+0000", 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3426000000000001e-05 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039481+0000", 2024-04-26T02:24:15.796 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4147000000000001e-05 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039502+0000", 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0832999999999999e-05 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039671+0000", 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000169467 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039696+0000", 2024-04-26T02:24:15.797 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4620000000000001e-05 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047901+0000", 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082056960000000002 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048000+0000", 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8422000000000001e-05 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.798 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.744160675, 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010661271, 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.799 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041762+0000", 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.44e-07 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.800 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041818+0000", 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6208999999999997e-05 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041850+0000", 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041876+0000", 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5426999999999999e-05 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.801 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042091+0000", 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021539399999999999 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042116+0000", 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4403e-05 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.802 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052304+0000", 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010188236999999999 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052423+0000", 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011882100000000001 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.803 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.743973247, 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012114710000000001, 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:15.804 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041950+0000", 2024-04-26T02:24:15.805 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041995+0000", 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4988999999999999e-05 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042019+0000", 2024-04-26T02:24:15.806 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4712999999999999e-05 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042038+0000", 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045071+0000", 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003033015 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045096+0000", 2024-04-26T02:24:15.807 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4607e-05 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053959+0000", 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088630800000000006 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054064+0000", 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104576 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.808 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 37/31 ECSubWrite(tid=32, reqid=osd.13.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.050443+0000", 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.735478725, 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035064919999999999, 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050443+0000", 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.809 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050443+0000", 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050445+0000", 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1799999999999999e-06 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050475+0000", 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9575999999999999e-05 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.810 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050510+0000", 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4566000000000001e-05 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050532+0000", 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1883e-05 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050752+0000", 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000220557 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.811 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050775+0000", 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3197000000000002e-05 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053865+0000", 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003089591 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053950+0000", 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4942000000000001e-05 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.812 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 37/31 ECSubWrite(tid=33, reqid=osd.13.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.051598+0000", 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.734323849999999, 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0055111700000000001, 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051598+0000", 2024-04-26T02:24:15.813 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051598+0000", 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051599+0000", 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.127e-06 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.814 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051627+0000", 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8129000000000001e-05 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051654+0000", 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6060000000000001e-05 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051674+0000", 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0509999999999998e-05 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.815 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051882+0000", 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020844400000000001 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051905+0000", 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2685999999999999e-05 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057025+0000", 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0051194919999999998 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.816 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057109+0000", 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4722000000000006e-05 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=65, reqid=osd.0.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.055469+0000", 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.730452675, 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003419587, 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.817 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055469+0000", 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055469+0000", 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055471+0000", 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.573e-06 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.818 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055495+0000", 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4053000000000002e-05 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055523+0000", 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8042999999999999e-05 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055549+0000", 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5902999999999999e-05 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.819 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055854+0000", 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030509899999999997 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.055879+0000", 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5164000000000002e-05 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.058808+0000", 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0029290499999999999 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.820 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.058889+0000", 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0702000000000001e-05 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 37/31 ECSubWrite(tid=46, reqid=client.4589.0:201, at_version=37'12, trim_to=0'0, roll_forward_to=34'10))", 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.065971+0000", 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.719950909, 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002424149, 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.821 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.065971+0000", 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.065971+0000", 2024-04-26T02:24:15.822 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.065972+0000", 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0299999999999999e-07 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.066039+0000", 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7376e-05 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.066069+0000", 2024-04-26T02:24:15.823 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9886000000000002e-05 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.066087+0000", 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7986999999999999e-05 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.066260+0000", 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017313800000000001 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.066291+0000", 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1129e-05 2024-04-26T02:24:15.824 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.068314+0000", 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020226609999999998 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.068395+0000", 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1369e-05 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.825 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 38/31 ECSubWrite(tid=66, reqid=osd.0.0:66, at_version=38'31, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.038525+0000", 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7473971800000001, 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0050321640000000004, 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038525+0000", 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.826 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038525+0000", 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038526+0000", 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.37e-07 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038602+0000", 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6722000000000002e-05 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.827 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038649+0000", 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6817000000000003e-05 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038673+0000", 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3659000000000002e-05 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038894+0000", 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000220917 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.828 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038919+0000", 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5182999999999999e-05 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043476+0000", 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004557144 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043557+0000", 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0984999999999998e-05 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.829 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7407262180000007, 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088105490000000009, 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.830 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045198+0000", 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7740000000000001e-06 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045280+0000", 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2705000000000002e-05 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.831 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045313+0000", 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2483000000000001e-05 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045335+0000", 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2316000000000001e-05 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046297+0000", 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00096208100000000005 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.832 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046319+0000", 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2238999999999998e-05 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053912+0000", 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007592639 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054006+0000", 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4312000000000001e-05 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.833 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 38/31 ECSubWrite(tid=49, reqid=osd.12.0:49, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7404812950000004, 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075694860000000003, 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:15.834 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9400000000000005e-07 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045486+0000", 2024-04-26T02:24:15.835 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4542999999999997e-05 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045512+0000", 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5649000000000001e-05 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045531+0000", 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9293e-05 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045943+0000", 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00041208100000000001 2024-04-26T02:24:15.836 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045966+0000", 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2952999999999999e-05 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.052897+0000", 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069310279999999997 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053010+0000", 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011334500000000001 2024-04-26T02:24:15.837 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7387936009999994, 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085403059999999992, 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.838 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047129+0000", 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.839 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047178+0000", 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8572999999999997e-05 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047206+0000", 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8422e-05 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047294+0000", 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8269000000000005e-05 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047694+0000", 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039957799999999999 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047729+0000", 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5002999999999997e-05 2024-04-26T02:24:15.841 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055582+0000", 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0078527289999999993 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055669+0000", 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7025000000000001e-05 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.842 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 38/31 ECSubWrite(tid=69, reqid=osd.0.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.055236+0000", 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7306864690000001, 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039445890000000001, 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055236+0000", 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.843 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055236+0000", 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055237+0000", 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6700000000000001e-06 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055262+0000", 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4706999999999999e-05 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.844 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055304+0000", 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.2159000000000001e-05 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055328+0000", 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4043e-05 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055511+0000", 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018258700000000001 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.845 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055535+0000", 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4547000000000001e-05 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059078+0000", 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035425169999999998 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059180+0000", 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000102359 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.846 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 38/31 ECSubWrite(tid=51, reqid=osd.12.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.055534+0000", 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7303875830000006, 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037696650000000002, 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055534+0000", 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055534+0000", 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055536+0000", 2024-04-26T02:24:15.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0729999999999999e-06 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055557+0000", 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.103e-05 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055580+0000", 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3462999999999999e-05 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055600+0000", 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9703000000000001e-05 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055860+0000", 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026061699999999999 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055884+0000", 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3229000000000001e-05 2024-04-26T02:24:15.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059184+0000", 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0033008550000000001 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.059304+0000", 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119695 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.851 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 38/31 ECSubWrite(tid=38, reqid=osd.13.0:38, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.058109+0000", 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7278134420000004, 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003876095, 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058109+0000", 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.852 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058109+0000", 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058111+0000", 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9870000000000002e-06 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058168+0000", 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7021999999999997e-05 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058211+0000", 2024-04-26T02:24:15.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3256000000000001e-05 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058235+0000", 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4403999999999999e-05 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058478+0000", 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00024319200000000001 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058503+0000", 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4997000000000001e-05 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.061889+0000", 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0033858410000000001 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.061985+0000", 2024-04-26T02:24:15.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5396000000000006e-05 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 38/31 ECSubWrite(tid=39, reqid=osd.13.0:34, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.060097+0000", 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.7258250759999996, 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041638559999999996, 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.856 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060097+0000", 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060097+0000", 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060099+0000", 2024-04-26T02:24:15.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8500000000000001e-06 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060125+0000", 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6103000000000001e-05 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060156+0000", 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1155999999999998e-05 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.858 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060178+0000", 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1546999999999999e-05 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060383+0000", 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020574699999999999 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060408+0000", 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4545999999999998e-05 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064172+0000", 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037643350000000002 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064261+0000", 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8572000000000005e-05 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 42/31 ECSubWrite(tid=71, reqid=client.4589.0:263, at_version=0'0, trim_to=0'0, roll_forward_to=42'27))", 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:10.133457+0000", 2024-04-26T02:24:15.860 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.6524653100000002, 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0019898939999999999, 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133457+0000", 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133457+0000", 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133458+0000", 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3400000000000001e-06 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133478+0000", 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0333999999999999e-05 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133509+0000", 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0168999999999999e-05 2024-04-26T02:24:15.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133526+0000", 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7153e-05 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133822+0000", 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029602399999999998 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.133852+0000", 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0446e-05 2024-04-26T02:24:15.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.135365+0000", 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015130860000000001 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.135447+0000", 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1341999999999995e-05 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 42/31 ECSubWrite(tid=15, reqid=client.4589.0:276, at_version=42'9, trim_to=0'0, roll_forward_to=40'8))", 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:10.162645+0000", 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.6232770649999999, 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0026961390000000002, 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.162645+0000", 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.162645+0000", 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.162645+0000", 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.13e-07 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.162978+0000", 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000332806 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163004+0000", 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6033999999999998e-05 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163020+0000", 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5400000000000002e-05 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163155+0000", 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000135761 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.163174+0000", 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8527000000000001e-05 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.165249+0000", 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020747949999999999 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.165341+0000", 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2303e-05 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.868 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 42/31 ECSubWrite(tid=16, reqid=client.4589.0:277, at_version=42'10, trim_to=0'0, roll_forward_to=40'8))", 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:10.168837+0000", 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.6170852609999997, 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002404762, 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.168837+0000", 2024-04-26T02:24:15.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.168837+0000", 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.168838+0000", 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.553e-06 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.169270+0000", 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00043211900000000001 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.169308+0000", 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8003000000000002e-05 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.169332+0000", 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3632999999999999e-05 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.169456+0000", 2024-04-26T02:24:15.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000124101 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.169471+0000", 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4773999999999999e-05 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.171155+0000", 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00168421 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.171242+0000", 2024-04-26T02:24:15.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6368999999999999e-05 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 42/31 ECSubWrite(tid=17, reqid=client.4589.0:278, at_version=42'11, trim_to=0'0, roll_forward_to=40'8))", 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:10.171855+0000", 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.6140672460000003, 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024866839999999999, 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.873 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.171855+0000", 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.171855+0000", 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.171856+0000", 2024-04-26T02:24:15.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.406e-06 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.172047+0000", 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019049799999999999 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.172081+0000", 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4422999999999999e-05 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.172104+0000", 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2535999999999999e-05 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.172216+0000", 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011210899999999999 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.172229+0000", 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3497e-05 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.174247+0000", 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020182329999999999 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.174341+0000", 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3981999999999996e-05 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:15.877 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:15.878 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:24:15.880 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:15.878+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:15.981 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:15.976+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:16.051 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:16.051 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:16.051 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:16.051 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:16.065 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:24:16.083 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:16.080+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:16.182 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:16.182 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:16.183 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:16.183 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:16.183 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:16.183 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:16.176+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:16.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:16.284 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:16.280+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:16.326 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:16.326 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:16.326 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:16.326 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 37/31 ECSubWrite(tid=43, reqid=osd.12.0:43, at_version=37'17, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.028434+0000", 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.294390042, 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0055233060000000004, 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028434+0000", 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028434+0000", 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028435+0000", 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1299999999999999e-07 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028501+0000", 2024-04-26T02:24:16.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5616000000000003e-05 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028526+0000", 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5826e-05 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028570+0000", 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3823999999999999e-05 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028821+0000", 2024-04-26T02:24:16.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000250623 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.028848+0000", 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7175999999999999e-05 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033847+0000", 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049993069999999997 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033958+0000", 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000110221 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 37/31 ECSubWrite(tid=44, reqid=osd.12.0:44, at_version=37'19, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.030112+0000", 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.292711793, 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063994619999999999, 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.331 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030112+0000", 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030112+0000", 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030115+0000", 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0999999999999998e-06 2024-04-26T02:24:16.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030181+0000", 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6239000000000001e-05 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030216+0000", 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5139999999999999e-05 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030238+0000", 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2569999999999999e-05 2024-04-26T02:24:16.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030403+0000", 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016425700000000001 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.030435+0000", 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2650000000000001e-05 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036411+0000", 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059754270000000002 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.036512+0000", 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101079 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.033229+0000", 2024-04-26T02:24:16.335 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.289595099, 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062283030000000001, 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033229+0000", 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033229+0000", 2024-04-26T02:24:16.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033230+0000", 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.37e-07 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033303+0000", 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3335000000000002e-05 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.337 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033356+0000", 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2936000000000003e-05 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033378+0000", 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2289999999999998e-05 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033570+0000", 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019183000000000001 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033594+0000", 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3516999999999999e-05 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039338+0000", 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057445830000000002 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039457+0000", 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000119275 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.339 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.034007+0000", 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.288816869, 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0076973689999999999, 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034007+0000", 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034007+0000", 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034009+0000", 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5430000000000001e-06 2024-04-26T02:24:16.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034052+0000", 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3155999999999998e-05 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034077+0000", 2024-04-26T02:24:16.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5193000000000001e-05 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034097+0000", 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9423e-05 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035378+0000", 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001280977 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035400+0000", 2024-04-26T02:24:16.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2317e-05 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041609+0000", 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062089770000000001 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041705+0000", 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5783000000000001e-05 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.344 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.047699+0000", 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.275125444, 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056234620000000001, 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047699+0000", 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047699+0000", 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047701+0000", 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.747e-06 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047752+0000", 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1282999999999997e-05 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047781+0000", 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9539e-05 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047802+0000", 2024-04-26T02:24:16.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0486999999999999e-05 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047942+0000", 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000140035 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047965+0000", 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2665999999999999e-05 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053235+0000", 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052700760000000003 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053322+0000", 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7628999999999997e-05 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.050841+0000", 2024-04-26T02:24:16.349 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.271983104, 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065677239999999996, 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050841+0000", 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050841+0000", 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050843+0000", 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.567e-06 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050868+0000", 2024-04-26T02:24:16.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5449999999999999e-05 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050899+0000", 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0409e-05 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050921+0000", 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2853e-05 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051125+0000", 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020369100000000001 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051160+0000", 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4418999999999997e-05 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057304+0000", 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061447400000000001 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057409+0000", 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104595 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:203 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.289709568999999, 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017435761000000001, 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 203 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033119+0000", 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1899999999999997e-06 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033136+0000", 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7200000000000001e-05 2024-04-26T02:24:16.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033176+0000", 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9603e-05 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033196+0000", 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0492999999999998e-05 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033371+0000", 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000174864 2024-04-26T02:24:16.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033394+0000", 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043073+0000", 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0096797610000000003 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043333+0000", 2024-04-26T02:24:16.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000259602 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050550+0000", 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072173649999999999 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:204 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.289578947000001, 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019331481000000001, 2024-04-26T02:24:16.359 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 204 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.360 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033247+0000", 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0870000000000001e-06 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033257+0000", 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8859999999999999e-06 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033277+0000", 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0213000000000001e-05 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033292+0000", 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4503e-05 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033585+0000", 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029350600000000002 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033603+0000", 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7706999999999998e-05 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044154+0000", 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010550888 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044306+0000", 2024-04-26T02:24:16.363 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000152258 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.052577+0000", 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082704330000000006 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 38/31 ECSubWrite(tid=35, reqid=osd.8.0:35, at_version=38'27, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033271+0000", 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.289553708, 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041828459999999996, 2024-04-26T02:24:16.364 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033271+0000", 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033271+0000", 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.365 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033271+0000", 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8999999999999995e-07 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.083e-05 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033351+0000", 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8958999999999998e-05 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033373+0000", 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1506999999999999e-05 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033530+0000", 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015748100000000001 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033556+0000", 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6023000000000001e-05 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.037369+0000", 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038129909999999999 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.037453+0000", 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4165000000000005e-05 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:205 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:16.368 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.289501925, 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020334097999999998, 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 205 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033324+0000", 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.297e-06 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033333+0000", 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2730000000000008e-06 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033352+0000", 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8768999999999999e-05 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033369+0000", 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7703999999999999e-05 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033691+0000", 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032162500000000003 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033707+0000", 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6135999999999999e-05 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047742+0000", 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014034835000000001 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.048005+0000", 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026275300000000001 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053656+0000", 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056517060000000003 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.373 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.287816702000001, 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012539899, 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035010+0000", 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.967e-06 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035065+0000", 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5315999999999997e-05 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035098+0000", 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2839000000000002e-05 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035119+0000", 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1787e-05 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035327+0000", 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020782 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035341+0000", 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3597e-05 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047462+0000", 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012120743999999999 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047547+0000", 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5828999999999994e-05 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.377 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.281818360999999, 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085734929999999997, 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.378 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9399999999999995e-07 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.379 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041059+0000", 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3072999999999998e-05 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041092+0000", 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2348999999999998e-05 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041115+0000", 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3027000000000002e-05 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.380 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041355+0000", 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00024024300000000001 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041381+0000", 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5629000000000001e-05 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.049358+0000", 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079771979999999996 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.381 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.049579+0000", 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022148 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.281226682, 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097802059999999996, 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.382 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5700000000000002e-07 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041673+0000", 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5065e-05 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041702+0000", 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9047000000000002e-05 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041725+0000", 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3136e-05 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042061+0000", 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033532599999999999 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042083+0000", 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2699000000000001e-05 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051259+0000", 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091760639999999994 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051378+0000", 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000118312 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpRead(3.9s0 38/31 ECSubRead(tid=36, to_read={3:998d036b:::smithi17529564-5:head=0,20480,0}, subchunks={3:998d036b:::smithi17529564-5:head=[0,1]}, attrs_to_read=))", 2024-04-26T02:24:16.386 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.044642+0000", 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.278182643999999, 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0044527660000000004, 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044642+0000", 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044642+0000", 2024-04-26T02:24:16.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044642+0000", 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044642+0000", 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044769+0000", 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012692500000000001 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044799+0000", 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0616e-05 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.048866+0000", 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0040672649999999996 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.049094+0000", 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022796000000000001 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 38/31 ECSubWrite(tid=39, reqid=osd.8.0:38, at_version=0'0, trim_to=0'0, roll_forward_to=38'31))", 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.062058+0000", 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.260766556, 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041747930000000004, 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.390 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062058+0000", 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062058+0000", 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062065+0000", 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0899999999999999e-06 2024-04-26T02:24:16.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062092+0000", 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7486000000000001e-05 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062424+0000", 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033165000000000001 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062450+0000", 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6437000000000001e-05 2024-04-26T02:24:16.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062612+0000", 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016203600000000001 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.062636+0000", 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3370000000000002e-05 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.066144+0000", 2024-04-26T02:24:16.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035083459999999999 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.066232+0000", 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8378e-05 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:207 3.9s0 3:998264a7:::smithi17529564-45:head [append 0~622592] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:07.065064+0000", 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2577601190000003, 2024-04-26T02:24:16.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010368989, 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 207 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065064+0000", 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065064+0000", 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065066+0000", 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3649999999999998e-06 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065918+0000", 2024-04-26T02:24:16.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00085115799999999997 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065941+0000", 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3363999999999999e-05 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065952+0000", 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.146e-05 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.066042+0000", 2024-04-26T02:24:16.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9071000000000002e-05 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.066060+0000", 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8893999999999999e-05 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.068303+0000", 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002242502 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.398 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.068413+0000", 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000110503 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.069819+0000", 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014055840000000001 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071529+0000", 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001709536 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.075367+0000", 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038380699999999998 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.075433+0000", 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6482000000000005e-05 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:208 3.9s0 3:998264a7:::smithi17529564-45:head [append 0~376832] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T02:24:16.400 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:07.071323+0000", 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2515008919999993, 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004851892, 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 208 2024-04-26T02:24:16.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071323+0000", 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071323+0000", 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.402 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071326+0000", 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2960000000000001e-06 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071719+0000", 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039375199999999998 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071736+0000", 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6914000000000001e-05 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071746+0000", 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2e-06 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071821+0000", 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5909999999999997e-05 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071958+0000", 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000136246 2024-04-26T02:24:16.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.072667+0000", 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00070915500000000005 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.074272+0000", 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001605045 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.076102+0000", 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0018299169999999999 2024-04-26T02:24:16.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.076175+0000", 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3456999999999998e-05 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:209 3.9s0 3:998264a7:::smithi17529564-45:head [setxattr _header (56) in=7b] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:07.071775+0000", 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2510492360000001, 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052800049999999999, 2024-04-26T02:24:16.406 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 209 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071775+0000", 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071775+0000", 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071776+0000", 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2240000000000001e-06 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071781+0000", 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8670000000000002e-06 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071792+0000", 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0682999999999999e-05 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071800+0000", 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7870000000000002e-06 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.073309+0000", 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001509626 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.073376+0000", 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7175000000000007e-05 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.073889+0000", 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00051290400000000001 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.074722+0000", 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00083248899999999995 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.076991+0000", 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022690800000000001 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.077055+0000", 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4170000000000004e-05 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:210 3.9s0 3:998264a7:::smithi17529564-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-04-26T02:24:16.411 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:07.071811+0000", 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2510129340000002, 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00677774, 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 210 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071811+0000", 2024-04-26T02:24:16.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071811+0000", 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071812+0000", 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2699999999999999e-07 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071816+0000", 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.856e-06 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071825+0000", 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8440000000000004e-06 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071832+0000", 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2309999999999999e-06 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.074569+0000", 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002737373 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.074665+0000", 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5691000000000003e-05 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.077440+0000", 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002774824 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.077523+0000", 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2857999999999998e-05 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.078589+0000", 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001066336 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:267 3.es0 3:7ba9a40e:::smithi17529564-23:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:16.416 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:10.132391+0000", 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 6.1904330639999996, 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0042609500000000003, 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 267 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132391+0000", 2024-04-26T02:24:16.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132391+0000", 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132394+0000", 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.224e-06 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:16.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132407+0000", 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2329e-05 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132440+0000", 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3439999999999998e-05 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132456+0000", 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6127e-05 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:16.419 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132591+0000", 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013464400000000001 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.132748+0000", 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000157245 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:10.136652+0000", 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039039410000000002 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.420 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:16.421 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:16.421 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:16.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:16.423 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:16.416+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:16.482 INFO:tasks.rados.rados.0.smithi175.stdout:128: done (2 left) 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:129: done (1 left) 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:130: done (0 left) 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:131: read oid 31 snap 7 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:131: expect (ObjNum 30 snap 0 seq_num 30) 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:132: rmattr oid 29 current snap is 9 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:132: done (1 left) 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:133: rollback oid 46 current snap is 9 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 46 to 4 2024-04-26T02:24:16.483 INFO:tasks.rados.rados.0.smithi175.stdout:134: snap_remove snap 8 2024-04-26T02:24:16.524 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:16.520+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:16.555 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:16.556 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:16.556 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:16.556 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:16.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:16.662 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:16.660+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:16.725 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:16.724+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:16.738 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:16.739 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:16.739 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:16.739 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:16.739 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:16.751 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:16.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:16.826 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:16.820+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:16.913 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:16.914 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.880641600000001, 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075357569999999997, 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.917 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033385+0000", 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4e-07 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033444+0000", 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9450999999999997e-05 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033476+0000", 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1979e-05 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033497+0000", 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0616999999999999e-05 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033684+0000", 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018750700000000001 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033709+0000", 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4912000000000001e-05 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040833+0000", 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071240510000000002 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040919+0000", 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6399999999999999e-05 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.879742899, 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010955845000000001, 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:16.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034285+0000", 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8669999999999998e-06 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034349+0000", 2024-04-26T02:24:16.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4090999999999993e-05 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034386+0000", 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6511999999999999e-05 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034409+0000", 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3198999999999999e-05 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035470+0000", 2024-04-26T02:24:16.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001061195 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035486+0000", 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5699999999999999e-05 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045121+0000", 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096354679999999995 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045238+0000", 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011681299999999999 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.875350919000001, 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077721719999999999, 2024-04-26T02:24:16.926 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:16.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038675+0000", 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038732+0000", 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024999999999997e-05 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038765+0000", 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2325e-05 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038789+0000", 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4905999999999998e-05 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039037+0000", 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024744900000000001 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039062+0000", 2024-04-26T02:24:16.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4719000000000002e-05 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046357+0000", 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072952980000000004 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046447+0000", 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9690000000000004e-05 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 37/31 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.042616+0000", 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.871408948999999, 2024-04-26T02:24:16.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044971869999999997, 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.042616+0000", 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.042616+0000", 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.042617+0000", 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4399999999999999e-07 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.042671+0000", 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4240999999999998e-05 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.042705+0000", 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3206e-05 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.042727+0000", 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2883000000000001e-05 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043038+0000", 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000311026 2024-04-26T02:24:16.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.043067+0000", 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8229e-05 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047025+0000", 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039582810000000001 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047114+0000", 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8577000000000003e-05 2024-04-26T02:24:16.935 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 37/31 ECSubWrite(tid=13, reqid=osd.15.0:13, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.047067+0000", 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.866958264000001, 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0041274850000000002, 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047067+0000", 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047067+0000", 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047068+0000", 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000004e-07 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047119+0000", 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1155000000000001e-05 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047147+0000", 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8331999999999999e-05 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047170+0000", 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2276000000000002e-05 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047331+0000", 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016131500000000001 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047354+0000", 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3422999999999999e-05 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051110+0000", 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037554400000000001 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051195+0000", 2024-04-26T02:24:16.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4766999999999997e-05 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.866041147000001, 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063472160000000001, 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:16.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047986+0000", 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9199999999999998e-06 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048038+0000", 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2228000000000002e-05 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048069+0000", 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0719000000000002e-05 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048096+0000", 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6458999999999999e-05 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048471+0000", 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037564800000000002 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048496+0000", 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4786e-05 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054242+0000", 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057465149999999998 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054331+0000", 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8941000000000001e-05 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.862809873, 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067178699999999999, 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051217+0000", 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0099999999999998e-06 2024-04-26T02:24:16.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051246+0000", 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8345999999999999e-05 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051275+0000", 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8921999999999999e-05 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051313+0000", 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7991999999999998e-05 2024-04-26T02:24:16.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051640+0000", 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032731600000000002 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051665+0000", 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4729e-05 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057825+0000", 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061603889999999996 2024-04-26T02:24:16.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057933+0000", 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010816599999999999 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 37/31 ECSubWrite(tid=33, reqid=osd.13.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.053288+0000", 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.860737574, 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004749975, 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.950 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053288+0000", 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053288+0000", 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053289+0000", 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2130000000000001e-06 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053310+0000", 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1469999999999999e-05 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053335+0000", 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4315999999999999e-05 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053357+0000", 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1815e-05 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053498+0000", 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014170599999999999 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053522+0000", 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3879e-05 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057958+0000", 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044356150000000004 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.058038+0000", 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9961000000000002e-05 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=29, reqid=osd.8.0:28, at_version=0'0, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.055636+0000", 2024-04-26T02:24:16.954 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.858389494000001, 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051422209999999998, 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055636+0000", 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055636+0000", 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055638+0000", 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6929999999999999e-06 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055662+0000", 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.478e-05 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055710+0000", 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7413999999999997e-05 2024-04-26T02:24:16.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055733+0000", 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3476e-05 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055920+0000", 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018722699999999999 2024-04-26T02:24:16.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055945+0000", 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4253e-05 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.060680+0000", 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047349549999999999 2024-04-26T02:24:16.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.060778+0000", 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8423000000000003e-05 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 37/31 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.055715+0000", 2024-04-26T02:24:16.959 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.858310367, 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050883530000000003, 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055715+0000", 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055715+0000", 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055716+0000", 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.474e-06 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055751+0000", 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4159000000000003e-05 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055777+0000", 2024-04-26T02:24:16.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6872e-05 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055796+0000", 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8953e-05 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055959+0000", 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016285400000000001 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.962 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055974+0000", 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5163e-05 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.060713+0000", 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004738155 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.060803+0000", 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0723000000000005e-05 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=35, reqid=osd.8.0:35, at_version=38'27, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.033243+0000", 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.880781948999999, 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039722179999999996, 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.964 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033243+0000", 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033243+0000", 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033244+0000", 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9700000000000002e-07 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033280+0000", 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5961999999999999e-05 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033302+0000", 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2059e-05 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033319+0000", 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6897000000000001e-05 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033478+0000", 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000158892 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.033494+0000", 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6864999999999999e-05 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.037145+0000", 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036509350000000001 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.037216+0000", 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0210999999999996e-05 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.968 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.878876767, 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018386527999999999, 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035150+0000", 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9230000000000001e-06 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035236+0000", 2024-04-26T02:24:16.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5860999999999997e-05 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035280+0000", 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3810999999999998e-05 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035303+0000", 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3223000000000001e-05 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035450+0000", 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014687200000000001 2024-04-26T02:24:16.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035475+0000", 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4623000000000001e-05 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053426+0000", 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017950875000000002 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053535+0000", 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010933999999999999 2024-04-26T02:24:16.972 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/31 ECSubWrite(tid=15, reqid=osd.15.0:15, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.035561+0000", 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.878463953000001, 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042353460000000001, 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035561+0000", 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035561+0000", 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035562+0000", 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7299999999999996e-07 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035689+0000", 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012653999999999999 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035706+0000", 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7941999999999999e-05 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035720+0000", 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3937000000000001e-05 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.975 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035907+0000", 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018665399999999999 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035933+0000", 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6259e-05 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.039704+0000", 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037703569999999998 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.976 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.039797+0000", 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3084000000000005e-05 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.872198665999999, 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012671968, 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:24:16.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041874+0000", 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6728999999999999e-05 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041914+0000", 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0312000000000003e-05 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041939+0000", 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4116000000000001e-05 2024-04-26T02:24:16.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042110+0000", 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000171094 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042135+0000", 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.493e-05 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054408+0000", 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012273386000000001 2024-04-26T02:24:16.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054499+0000", 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0650999999999997e-05 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.867593274000001, 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082587159999999993, 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.981 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046434+0000", 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.193e-06 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046463+0000", 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046509+0000", 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6078000000000002e-05 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046565+0000", 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6048999999999998e-05 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046730+0000", 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165408 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046747+0000", 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6353000000000001e-05 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054637+0000", 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078899409999999993 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054691+0000", 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4200999999999998e-05 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 38/31 ECSubWrite(tid=38, reqid=osd.13.0:38, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:16.985 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.056936+0000", 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.857089403, 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0040698109999999996, 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056936+0000", 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056936+0000", 2024-04-26T02:24:16.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056938+0000", 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.576e-06 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056985+0000", 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7818999999999997e-05 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.057016+0000", 2024-04-26T02:24:16.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0791999999999999e-05 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.057037+0000", 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0976e-05 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.057228+0000", 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000190531 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.057252+0000", 2024-04-26T02:24:16.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4579e-05 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.060892+0000", 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0036396810000000001 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061006+0000", 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113857 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 42/31 ECSubWrite(tid=44, reqid=client.4589.0:255, at_version=0'0, trim_to=0'0, roll_forward_to=42'36))", 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:10.080640+0000", 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.8333858159999998, 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058679439999999999, 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080640+0000", 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080640+0000", 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080641+0000", 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.46e-06 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080659+0000", 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8468999999999999e-05 2024-04-26T02:24:16.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080684+0000", 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4196e-05 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080699+0000", 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5322999999999999e-05 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080814+0000", 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011492 2024-04-26T02:24:16.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080831+0000", 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7252999999999999e-05 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.086415+0000", 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055835989999999999 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.086507+0000", 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2724000000000002e-05 2024-04-26T02:24:16.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=91, reqid=client.4589.0:324, at_version=48'22, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.487518+0000", 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4265070010000001, 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043596579999999998, 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487518+0000", 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487518+0000", 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487519+0000", 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.37e-07 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:16.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487571+0000", 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2070999999999997e-05 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487596+0000", 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5299999999999998e-05 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487619+0000", 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2923000000000001e-05 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:16.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487783+0000", 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000163392 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487811+0000", 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8856e-05 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491794+0000", 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0039827009999999999 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491878+0000", 2024-04-26T02:24:16.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3877999999999999e-05 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=92, reqid=client.4589.0:325, at_version=48'23, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.490261+0000", 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4237643520000001, 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060390089999999997, 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490261+0000", 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490261+0000", 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:16.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490263+0000", 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8840000000000001e-06 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490311+0000", 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7972000000000001e-05 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490342+0000", 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1408999999999997e-05 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490365+0000", 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2583e-05 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491111+0000", 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00074644399999999997 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491127+0000", 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5852999999999999e-05 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496176+0000", 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050483730000000001 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496300+0000", 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012449100000000001 2024-04-26T02:24:17.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=93, reqid=client.4589.0:326, at_version=48'24, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.491809+0000", 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.4222163050000001, 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004565983, 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:17.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491809+0000", 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491809+0000", 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491811+0000", 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6729999999999999e-06 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:17.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491853+0000", 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1936e-05 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491883+0000", 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0409e-05 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491906+0000", 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2719999999999999e-05 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:17.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493056+0000", 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001149857 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493079+0000", 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3343e-05 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496307+0000", 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0032284340000000001 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:17.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496375+0000", 2024-04-26T02:24:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7611e-05 2024-04-26T02:24:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:17.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:17.007 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:17.008 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:17.008 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:17.009 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:17.009 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:17.010 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:17.010 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:17.011 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:17.011 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:17.012 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:17.004+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:17.012 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:17.012 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:17.034 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:17.034 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:17.057 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:17.057 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:17.080 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:17.081 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:17.101 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:17.101 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:17.110 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:17.104+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:17.123 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:17.140 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:17.140 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:17.146 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:17.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:17.165 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:17.189 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:17.190 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:17.210 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:17.210 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:17.210 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:17.208+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:17.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:17.204+0000 7fed1b7fe640 0 -- 172.21.15.59:0/473882807 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7fed1c229dc0 msgr2=0x7fed1c22c1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:17.276 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:17.276 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:17.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:17.318 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:17.312+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:17.416 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:17.416 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:17.416 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:17.412+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:17.431 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:17.436 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:17.436 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:17.457 INFO:tasks.rados.rados.0.smithi175.stdout:134: done (2 left) 2024-04-26T02:24:17.457 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 48 current snap is 9 2024-04-26T02:24:17.457 INFO:tasks.rados.rados.0.smithi175.stdout:135: seq_num 83 ranges {802816=638976,1441792=622592,2064384=147456} 2024-04-26T02:24:17.480 INFO:tasks.rados.rados.0.smithi175.stdout:135: writing smithi17529564-48 from 802816 to 1441792 tid 1 2024-04-26T02:24:17.491 INFO:tasks.rados.rados.0.smithi175.stdout:135: writing smithi17529564-48 from 1441792 to 2064384 tid 2 2024-04-26T02:24:17.495 INFO:tasks.rados.rados.0.smithi175.stdout:135: writing smithi17529564-48 from 2064384 to 2211840 tid 3 2024-04-26T02:24:17.495 INFO:tasks.rados.rados.0.smithi175.stdout:136: read oid 32 snap -1 2024-04-26T02:24:17.495 INFO:tasks.rados.rados.0.smithi175.stdout:136: expect (ObjNum 31 snap 0 seq_num 31) 2024-04-26T02:24:17.495 INFO:tasks.rados.rados.0.smithi175.stdout:137: read oid 35 snap -1 2024-04-26T02:24:17.495 INFO:tasks.rados.rados.0.smithi175.stdout:137: expect deleted 2024-04-26T02:24:17.495 INFO:tasks.rados.rados.0.smithi175.stdout:138: rollback oid 47 current snap is 9 2024-04-26T02:24:17.495 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 47 to 4 2024-04-26T02:24:17.496 INFO:tasks.rados.rados.0.smithi175.stdout:133: finishing rollback tid 0 to smithi17529564-46 2024-04-26T02:24:17.496 INFO:tasks.rados.rados.0.smithi175.stdout:131: expect (ObjNum 30 snap 0 seq_num 30) 2024-04-26T02:24:17.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:24:17.517 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:17.512+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:17.542 INFO:tasks.rados.rados.0.smithi175.stdout:133: finishing rollback tid 1 to smithi17529564-46 2024-04-26T02:24:17.542 INFO:tasks.rados.rados.0.smithi175.stdout:133: finishing rollback tid 2 to smithi17529564-46 2024-04-26T02:24:17.542 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 46 v 37 (ObjNum 53 snap 2 seq_num 53) dirty exists 2024-04-26T02:24:17.542 INFO:tasks.rados.rados.0.smithi175.stdout:135: finishing write tid 1 to smithi17529564-48 2024-04-26T02:24:17.542 INFO:tasks.rados.rados.0.smithi175.stdout:131: done (5 left) 2024-04-26T02:24:17.542 INFO:tasks.rados.rados.0.smithi175.stdout:133: done (4 left) 2024-04-26T02:24:17.542 INFO:tasks.rados.rados.0.smithi175.stdout:137: done (3 left) 2024-04-26T02:24:17.543 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 46 current snap is 9 2024-04-26T02:24:17.543 INFO:tasks.rados.rados.0.smithi175.stdout:139: seq_num 84 ranges {1671168=655360,2326528=638976,2965504=131072} 2024-04-26T02:24:17.557 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:17.557 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:17.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:17.576 INFO:tasks.rados.rados.0.smithi175.stdout:139: writing smithi17529564-46 from 1671168 to 2326528 tid 1 2024-04-26T02:24:17.584 INFO:tasks.rados.rados.0.smithi175.stdout:139: writing smithi17529564-46 from 2326528 to 2965504 tid 2 2024-04-26T02:24:17.586 INFO:tasks.rados.rados.0.smithi175.stdout:139: writing smithi17529564-46 from 2965504 to 3096576 tid 3 2024-04-26T02:24:17.586 INFO:tasks.rados.rados.0.smithi175.stdout:140: snap_remove snap 7 2024-04-26T02:24:17.618 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:17.614+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:17.718 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:17.716+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:17.739 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:17.739 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:17.753 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:17.819 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:17.812+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:17.917 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:17.917 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:17.921 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:17.916+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:17.932 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:18.021 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:18.018+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:18.055 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:18.055 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:18.069 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:18.122 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:18.120+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:18.189 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:18.189 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:18.204 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:18.246 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:18.244+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:18.324 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:18.322+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:18.370 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:18.371 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:18.385 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:18.431 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:18.430+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:18.477 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:18.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T02:24:18.493 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:24:18.499 INFO:tasks.rados.rados.0.smithi175.stdout:140: done (4 left) 2024-04-26T02:24:18.499 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 30 current snap is 9 2024-04-26T02:24:18.499 INFO:tasks.rados.rados.0.smithi175.stdout:136: expect (ObjNum 31 snap 0 seq_num 31) 2024-04-26T02:24:18.525 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:18.522+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:18.525 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:18.526 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:18.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:18.545 INFO:tasks.rados.rados.0.smithi175.stdout:135: finishing write tid 2 to smithi17529564-48 2024-04-26T02:24:18.545 INFO:tasks.rados.rados.0.smithi175.stdout:138: finishing rollback tid 0 to smithi17529564-47 2024-04-26T02:24:18.545 INFO:tasks.rados.rados.0.smithi175.stdout:138: finishing rollback tid 1 to smithi17529564-47 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: finishing write tid 3 to smithi17529564-48 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: finishing write tid 4 to smithi17529564-48 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:138: finishing rollback tid 2 to smithi17529564-47 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 32 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: finishing write tid 5 to smithi17529564-48 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: oid 48 updating version 0 to 18 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: oid 48 updating version 18 to 21 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: oid 48 version 21 is already newer than 20 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: oid 48 version 21 is already newer than 19 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 48 v 21 (ObjNum 83 snap 9 seq_num 83) dirty exists 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:135: left oid 48 (ObjNum 83 snap 9 seq_num 83) 2024-04-26T02:24:18.546 INFO:tasks.rados.rados.0.smithi175.stdout:141: seq_num 85 ranges {1048576=671744,1720320=770048} 2024-04-26T02:24:18.554 INFO:tasks.rados.rados.0.smithi175.stdout:141: writing smithi17529564-30 from 1048576 to 1720320 tid 1 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:141: writing smithi17529564-30 from 1720320 to 2490368 tid 2 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:135: done (4 left) 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:136: done (3 left) 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:138: done (2 left) 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:142: snap_create 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:139: finishing write tid 1 to smithi17529564-46 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:139: finishing write tid 2 to smithi17529564-46 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:139: finishing write tid 3 to smithi17529564-46 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:139: finishing write tid 4 to smithi17529564-46 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:139: finishing write tid 5 to smithi17529564-46 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:139: oid 46 updating version 0 to 40 2024-04-26T02:24:18.560 INFO:tasks.rados.rados.0.smithi175.stdout:139: oid 46 updating version 40 to 42 2024-04-26T02:24:18.561 INFO:tasks.rados.rados.0.smithi175.stdout:139: oid 46 version 42 is already newer than 41 2024-04-26T02:24:18.561 INFO:tasks.rados.rados.0.smithi175.stdout:139: oid 46 updating version 42 to 43 2024-04-26T02:24:18.561 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 46 v 43 (ObjNum 84 snap 9 seq_num 84) dirty exists 2024-04-26T02:24:18.561 INFO:tasks.rados.rados.0.smithi175.stdout:139: left oid 46 (ObjNum 84 snap 9 seq_num 84) 2024-04-26T02:24:18.565 INFO:tasks.rados.rados.0.smithi175.stdout:141: finishing write tid 1 to smithi17529564-30 2024-04-26T02:24:18.566 INFO:tasks.rados.rados.0.smithi175.stdout:141: finishing write tid 2 to smithi17529564-30 2024-04-26T02:24:18.567 INFO:tasks.rados.rados.0.smithi175.stdout:141: finishing write tid 3 to smithi17529564-30 2024-04-26T02:24:18.569 INFO:tasks.rados.rados.0.smithi175.stdout:141: finishing write tid 4 to smithi17529564-30 2024-04-26T02:24:18.569 INFO:tasks.rados.rados.0.smithi175.stdout:141: oid 30 updating version 0 to 31 2024-04-26T02:24:18.569 INFO:tasks.rados.rados.0.smithi175.stdout:141: oid 30 version 31 is already newer than 30 2024-04-26T02:24:18.569 INFO:tasks.rados.rados.0.smithi175.stdout:141: oid 30 version 31 is already newer than 29 2024-04-26T02:24:18.569 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 31 (ObjNum 85 snap 9 seq_num 85) dirty exists 2024-04-26T02:24:18.569 INFO:tasks.rados.rados.0.smithi175.stdout:141: left oid 30 (ObjNum 85 snap 9 seq_num 85) 2024-04-26T02:24:18.626 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:18.620+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:18.669 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:18.669 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:18.683 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:18.727 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:18.724+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:18.829 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:18.826+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:18.854 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:18.854 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:18.870 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:18.929 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:18.924+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:19.031 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:19.031 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:19.031 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:19.028+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:19.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:19.132 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:19.128+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:19.170 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:19.170 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:19.184 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:19.233 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:19.228+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:19.306 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:19.307 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:19.321 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:19.334 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:19.332+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:19.435 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:19.432+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:19.444 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:19.444 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:19.458 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:19.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:19.497 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T02:24:19.503 INFO:tasks.rados.rados.0.smithi175.stdout:139: done (2 left) 2024-04-26T02:24:19.503 INFO:tasks.rados.rados.0.smithi175.stdout:141: done (1 left) 2024-04-26T02:24:19.503 INFO:tasks.rados.rados.0.smithi175.stdout:142: done (0 left) 2024-04-26T02:24:19.503 INFO:tasks.rados.rados.0.smithi175.stdout:143: snap_create 2024-04-26T02:24:19.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T02:24:19.535 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:19.534+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:19.579 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:19.580 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:19.594 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:24:19.625 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:19.626 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:19.636 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:19.632+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:19.664 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:19.665 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:19.698 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:19.698 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:19.722 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:19.722 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:19.737 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:19.734+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:19.740 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:19.740 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:19.761 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:19.762 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:19.762 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:19.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:24:19.781 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:19.782 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:19.801 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:19.803 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:19.867 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:19.866+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:19.939 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:19.940 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:19.940 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:19.938+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:19.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:24:20.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:20.023 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:20.041 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:20.036+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:20.044 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:20.045 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:20.066 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:20.066 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:20.094 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:20.095 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:20.112 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:20.112 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:20.120 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:20.120 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:20.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:24:20.145 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:20.146 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:20.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:20.140+0000 7fa3fe59c640 0 -- 172.21.15.59:0/919705039 >> [v2:172.21.15.142:6809/4003882581,v1:172.21.15.142:6811/4003882581] conn(0x7fa4002204d0 msgr2=0x7fa4002228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:20.171 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:20.170+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:20.243 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:20.238+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:20.249 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:20.249 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:20.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:24:20.344 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:20.340+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:20.385 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:20.385 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:20.419 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:20.420 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:20.423 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:20.423 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:20.423 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:20.423 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:20.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:24:20.484 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:20.480+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:20.508 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T02:24:20.514 INFO:tasks.rados.rados.0.smithi175.stdout:143: done (0 left) 2024-04-26T02:24:20.514 INFO:tasks.rados.rados.0.smithi175.stdout:144: snap_create 2024-04-26T02:24:20.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T02:24:20.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T02:24:20.546 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:20.544+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:20.568 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:20.568 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:20.568 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:20.569 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:20.569 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:20.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:24:20.647 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:20.644+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:20.748 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:20.744+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:252 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.679379592, 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018057229000000001, 2024-04-26T02:24:20.754 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 252 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.755 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071932+0000", 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6830000000000001e-06 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071949+0000", 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.747e-05 2024-04-26T02:24:20.756 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071991+0000", 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1634999999999997e-05 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072017+0000", 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5732999999999999e-05 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072400+0000", 2024-04-26T02:24:20.757 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038336099999999998 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072421+0000", 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1086000000000001e-05 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083152+0000", 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010731001 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.758 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083378+0000", 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022567 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089985+0000", 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00660759 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:253 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:20.759 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.679223607000001, 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018975438000000001, 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 253 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:20.760 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072086+0000", 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5629999999999999e-06 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.761 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072096+0000", 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0586e-05 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072127+0000", 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072144+0000", 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7694e-05 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072656+0000", 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000511967 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072677+0000", 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0908999999999999e-05 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.084846+0000", 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012169164 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.085079+0000", 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000232613 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.091060+0000", 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059807230000000003 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:254 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.679128825999999, 2024-04-26T02:24:20.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.02061644, 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 254 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072180+0000", 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.393e-06 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072190+0000", 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6320000000000003e-06 2024-04-26T02:24:20.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072216+0000", 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5667e-05 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072250+0000", 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4261999999999998e-05 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072786+0000", 2024-04-26T02:24:20.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053627299999999998 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072805+0000", 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8787000000000002e-05 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.086864+0000", 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014058795000000001 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.087018+0000", 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000154492 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092795+0000", 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057771389999999997 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.769 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.770 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:268 3.cs0 3:38720ec9:::smithi17529564-41:head [read 0~688128,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.770 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.137918+0000", 2024-04-26T02:24:20.770 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.6133893, 2024-04-26T02:24:20.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064003410000000004, 2024-04-26T02:24:20.773 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.773 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.773 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.773 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.773 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.773 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 268 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.137918+0000", 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.137918+0000", 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.137923+0000", 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8369999999999996e-06 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.137970+0000", 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7141000000000001e-05 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138008+0000", 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7639000000000003e-05 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138030+0000", 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2353000000000001e-05 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138222+0000", 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000191478 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138488+0000", 2024-04-26T02:24:20.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026580100000000003 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.144319+0000", 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058310920000000004 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.777 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:269 3.cs0 3:38720ec9:::smithi17529564-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.138131+0000", 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.613176960000001, 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073866940000000001, 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 269 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.778 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138131+0000", 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138131+0000", 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138133+0000", 2024-04-26T02:24:20.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.917e-06 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138151+0000", 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8743e-05 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138178+0000", 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6588999999999999e-05 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.780 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138196+0000", 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7813e-05 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.139443+0000", 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001247054 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.139601+0000", 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015843899999999999 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.145518+0000", 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059161389999999999 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:270 3.cs0 3:38720ec9:::smithi17529564-41:head [read 0~688128,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.782 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.138227+0000", 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.613081219, 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008821499, 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 270 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.783 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138227+0000", 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138227+0000", 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138228+0000", 2024-04-26T02:24:20.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3999999999999999e-06 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138237+0000", 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3889999999999994e-06 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138260+0000", 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3045999999999999e-05 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.138278+0000", 2024-04-26T02:24:20.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7139999999999999e-05 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142141+0000", 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038635179999999998 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142383+0000", 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000242279 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.147048+0000", 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046647269999999996 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:286 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~557056] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.180772+0000", 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.570536168, 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014369155999999999, 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.787 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 286 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180772+0000", 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180772+0000", 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180775+0000", 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0510000000000001e-06 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181827+0000", 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001052765 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181885+0000", 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7552000000000001e-05 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181910+0000", 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5488000000000001e-05 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.182101+0000", 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019085 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.182318+0000", 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0002163 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.184300+0000", 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019825419999999999 2024-04-26T02:24:20.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186847+0000", 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002547246 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.194976+0000", 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081289740000000006 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195141+0000", 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016438800000000001 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:287 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~671744] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.564856268, 2024-04-26T02:24:20.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20982231300000001, 2024-04-26T02:24:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.794 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 287 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:20.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186454+0000", 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.599e-06 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188135+0000", 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001681297 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188161+0000", 2024-04-26T02:24:20.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5639999999999998e-05 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188176+0000", 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4696e-05 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188349+0000", 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000173361 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188599+0000", 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025008099999999998 2024-04-26T02:24:20.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190936+0000", 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023371910000000002 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.194810+0000", 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038734189999999999 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396085+0000", 2024-04-26T02:24:20.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20127497799999999 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396274+0000", 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000189051 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:288 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~98304] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.563021533000001, 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.208333828, 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.799 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 288 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188288+0000", 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8679999999999999e-06 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188377+0000", 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9355000000000001e-05 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.801 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188412+0000", 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4533000000000003e-05 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188433+0000", 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0662e-05 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192429+0000", 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039958980000000003 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192696+0000", 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026725799999999998 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.193713+0000", 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001017394 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196898+0000", 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031851710000000001 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396498+0000", 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.19959943599999999 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396620+0000", 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012225300000000001 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:289 3.fs0 3:f4c4efcf:::smithi17529564-16:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:20.804 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.562836439, 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.210050292, 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 289 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188473+0000", 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188482+0000", 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-04-26T02:24:20.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188514+0000", 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1452999999999999e-05 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188530+0000", 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6079999999999999e-05 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195465+0000", 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0069355390000000001 2024-04-26T02:24:20.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195614+0000", 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149087 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196510+0000", 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089556900000000003 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197757+0000", 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012469650000000001 2024-04-26T02:24:20.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398371+0000", 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20061418 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398522+0000", 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015068199999999999 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:290 3.fs0 3:f4c4efcf:::smithi17529564-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:20.809 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.562752722000001, 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.212763806, 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 290 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:20.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188556+0000", 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.437e-06 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188563+0000", 2024-04-26T02:24:20.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9630000000000001e-06 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188584+0000", 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0262e-05 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188603+0000", 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9242999999999999e-05 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196982+0000", 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008379226 2024-04-26T02:24:20.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197132+0000", 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149875 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399173+0000", 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.202040675 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399311+0000", 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000138243 2024-04-26T02:24:20.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.401319+0000", 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020078819999999999 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:324 3.fs0 3:fc34d3d4:::smithi17529564-31:head [append 0~0] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.268184346, 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015454763999999999, 2024-04-26T02:24:20.814 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 324 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483125+0000", 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.849e-06 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483134+0000", 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7809999999999994e-06 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483153+0000", 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8841000000000001e-05 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483169+0000", 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5739999999999998e-05 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483254+0000", 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5785999999999995e-05 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483262+0000", 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.418e-06 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.486485+0000", 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032228140000000001 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.486647+0000", 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000162557 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.487943+0000", 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001295488 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.492691+0000", 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047483480000000003 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498449+0000", 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005757921 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498578+0000", 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000129221 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:325 3.fs0 3:fc34d3d4:::smithi17529564-31:head [rollback 6] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.2681041259999999, 2024-04-26T02:24:20.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01566555, 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 325 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9999999999999997e-07 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483208+0000", 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9210000000000002e-06 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483218+0000", 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3370000000000006e-06 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483227+0000", 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769999999999994e-06 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483367+0000", 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014014999999999999 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483382+0000", 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4545999999999999e-05 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.488926+0000", 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005544602 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.489142+0000", 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000215338 2024-04-26T02:24:20.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.490131+0000", 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00098933399999999992 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.496700+0000", 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065690790000000002 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498752+0000", 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020519259999999999 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498869+0000", 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011734 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.826 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:326 3.fs0 3:fc34d3d4:::smithi17529564-31:head [append 0~0] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.2680657990000004, 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016185303000000002, 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 326 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483243+0000", 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-04-26T02:24:20.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483247+0000", 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0450000000000002e-06 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483259+0000", 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2077e-05 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483268+0000", 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8100000000000004e-06 2024-04-26T02:24:20.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483438+0000", 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000170815 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483448+0000", 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7389999999999994e-06 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.491090+0000", 2024-04-26T02:24:20.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076419920000000002 2024-04-26T02:24:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.491253+0000", 2024-04-26T02:24:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016303800000000001 2024-04-26T02:24:20.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.492098+0000", 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00084462600000000001 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.496789+0000", 2024-04-26T02:24:20.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046916220000000003 2024-04-26T02:24:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.499227+0000", 2024-04-26T02:24:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024372529999999999 2024-04-26T02:24:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.499427+0000", 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000200638 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:329 3.fs0 3:fc34d3d4:::smithi17529564-31:9 [read 0~507904,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:20.834 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483527+0000", 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.2677810990000005, 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011436829000000001, 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 329 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483527+0000", 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483527+0000", 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483530+0000", 2024-04-26T02:24:20.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6229999999999999e-06 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483546+0000", 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.579e-05 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483585+0000", 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8835999999999999e-05 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483605+0000", 2024-04-26T02:24:20.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0358999999999999e-05 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483786+0000", 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018107900000000001 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3136e-05 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488140+0000", 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004330548 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488326+0000", 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018549199999999999 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494964+0000", 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066379660000000004 2024-04-26T02:24:20.839 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:330 3.fs0 3:fc34d3d4:::smithi17529564-31:9 [read 0~507904,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483645+0000", 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.2676628760000002, 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012876799, 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.840 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 330 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483645+0000", 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483645+0000", 2024-04-26T02:24:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483646+0000", 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.457e-06 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483659+0000", 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.27e-05 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483681+0000", 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2316000000000001e-05 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483698+0000", 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7033000000000001e-05 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483973+0000", 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000275016 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483985+0000", 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1433e-05 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489483+0000", 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0054983549999999999 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489659+0000", 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017537600000000001 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.496522+0000", 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068631129999999997 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:331 3.fs0 3:fc34d3d4:::smithi17529564-31:9 [read 0~507904,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483730+0000", 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.2675782609999997, 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014531919000000001, 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.846 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 331 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483730+0000", 2024-04-26T02:24:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483730+0000", 2024-04-26T02:24:20.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483731+0000", 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3069999999999999e-06 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483739+0000", 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1300000000000001e-06 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483759+0000", 2024-04-26T02:24:20.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9811999999999999e-05 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483775+0000", 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6062999999999999e-05 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484068+0000", 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029358599999999998 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484088+0000", 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9213000000000001e-05 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.491377+0000", 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072898549999999996 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.491695+0000", 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031801600000000001 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498261+0000", 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006565937 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:332 3.cs0 3:3fb4b57b:::smithi17529564-46:head [append 0~0] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.2674977160000003, 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014564338, 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.852 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 332 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.853 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483812+0000", 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4559999999999999e-06 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483819+0000", 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2200000000000003e-06 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483840+0000", 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1665999999999999e-05 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483856+0000", 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5270000000000001e-05 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484001+0000", 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014564600000000001 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484024+0000", 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2875999999999999e-05 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488065+0000", 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040404899999999999 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488246+0000", 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181788 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489812+0000", 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001565823 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497402+0000", 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075900050000000004 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498113+0000", 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00071069199999999996 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498374+0000", 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000261406 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:333 3.cs0 3:3fb4b57b:::smithi17529564-46:head [rollback 6] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.2674207749999997, 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015996089000000002, 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 333 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483888+0000", 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.367e-06 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483895+0000", 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0859999999999996e-06 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483918+0000", 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2926e-05 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483933+0000", 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5073e-05 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484094+0000", 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000161003 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484112+0000", 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7808999999999998e-05 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.491940+0000", 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078274620000000003 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.492202+0000", 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026212700000000002 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.862 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.493787+0000", 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001585562 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497739+0000", 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003951319 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.499764+0000", 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020257140000000001 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.499883+0000", 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118641 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:334 3.cs0 3:3fb4b57b:::smithi17529564-46:head [append 0~0] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.2673266969999997, 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016347856000000001, 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:20.864 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 334 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483982+0000", 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483987+0000", 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7589999999999997e-06 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484006+0000", 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9117e-05 2024-04-26T02:24:20.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484027+0000", 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0922000000000001e-05 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484169+0000", 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014197999999999999 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484178+0000", 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3260000000000002e-06 2024-04-26T02:24:20.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494927+0000", 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010748627 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.495181+0000", 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025385000000000002 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.496382+0000", 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001201793 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498738+0000", 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002355359 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.500202+0000", 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001464676 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.500329+0000", 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012651700000000001 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.869 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:20.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:20.870 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:20.871 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:24:20.872 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:20.868+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:20.972 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:20.968+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:20.993 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:20.993 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:20.994 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:20.994 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:21.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:24:21.074 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:21.068+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:21.135 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:21.135 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:21.135 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:21.135 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:21.135 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:21.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:24:21.174 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:21.168+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:21.276 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:21.274+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:21.320 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:21.320 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 37/31 ECSubWrite(tid=43, reqid=osd.12.0:43, at_version=37'17, trim_to=0'0, roll_forward_to=36'15))", 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.029228+0000", 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.288476638999999, 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029061579999999998, 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.321 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029228+0000", 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029228+0000", 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029229+0000", 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9900000000000002e-07 2024-04-26T02:24:21.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029258+0000", 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9295e-05 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029282+0000", 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3852000000000001e-05 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029297+0000", 2024-04-26T02:24:21.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5506e-05 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029519+0000", 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022130300000000001 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.029532+0000", 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3004e-05 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032086+0000", 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0025542120000000001 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.032135+0000", 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8687000000000003e-05 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 37/31 ECSubWrite(tid=45, reqid=osd.12.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.039580+0000", 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.278125490000001, 2024-04-26T02:24:21.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046717809999999999, 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039580+0000", 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039580+0000", 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039580+0000", 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0399999999999996e-07 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039593+0000", 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2907e-05 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039607+0000", 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3757999999999999e-05 2024-04-26T02:24:21.327 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039619+0000", 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2139e-05 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039871+0000", 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025258600000000001 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039886+0000", 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4195999999999999e-05 2024-04-26T02:24:21.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.044194+0000", 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043084919999999997 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.044251+0000", 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7198999999999999e-05 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.329 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.039880+0000", 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.277824687999999, 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042990019999999997, 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039880+0000", 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039880+0000", 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039881+0000", 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.65e-07 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039913+0000", 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1924000000000001e-05 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039928+0000", 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5619000000000001e-05 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039939+0000", 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1163e-05 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040058+0000", 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011824000000000001 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040070+0000", 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2534000000000001e-05 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.044107+0000", 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040366200000000003 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.044179+0000", 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2537e-05 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.039970+0000", 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.277734808000002, 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004171096, 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.334 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.335 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039970+0000", 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039970+0000", 2024-04-26T02:24:21.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039971+0000", 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6899999999999997e-07 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039994+0000", 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3411e-05 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040007+0000", 2024-04-26T02:24:21.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2379e-05 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040020+0000", 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3059e-05 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040278+0000", 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025872100000000001 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040286+0000", 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8450000000000003e-06 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.044090+0000", 2024-04-26T02:24:21.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038041049999999999 2024-04-26T02:24:21.340 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.044141+0000", 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1007000000000001e-05 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 37/31 ECSubWrite(tid=33, reqid=osd.13.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:21.341 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.265593343999999, 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060489920000000004, 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1500000000000004e-07 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052123+0000", 2024-04-26T02:24:21.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0360000000000001e-05 2024-04-26T02:24:21.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052133+0000", 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052143+0000", 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7319999999999993e-06 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052254+0000", 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011064 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052264+0000", 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0154e-05 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058071+0000", 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058070220000000002 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058161+0000", 2024-04-26T02:24:21.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9919000000000004e-05 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 37/31 ECSubWrite(tid=46, reqid=client.4589.0:201, at_version=37'12, trim_to=0'0, roll_forward_to=34'10))", 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.065723+0000", 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.251981815000001, 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039255009999999996, 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.347 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065723+0000", 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065723+0000", 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065725+0000", 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.46e-06 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065755+0000", 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0516000000000001e-05 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065782+0000", 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6463000000000001e-05 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065794+0000", 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1895999999999999e-05 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065866+0000", 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2061e-05 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065877+0000", 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1287000000000001e-05 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.350 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069602+0000", 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037252119999999999 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069649+0000", 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6606000000000001e-05 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.041560+0000", 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.27614473, 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028399549999999999, 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041560+0000", 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041560+0000", 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041561+0000", 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1800000000000002e-07 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041589+0000", 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8836999999999999e-05 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041616+0000", 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6682e-05 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041640+0000", 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3788e-05 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041929+0000", 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028866999999999999 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041939+0000", 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0484e-05 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.044370+0000", 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024313910000000002 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.044400+0000", 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9785e-05 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 38/31 ECSubWrite(tid=49, reqid=osd.12.0:49, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.041671+0000", 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.276034405000001, 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002300014, 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.356 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041671+0000", 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041671+0000", 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041671+0000", 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8999999999999997e-07 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041703+0000", 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2075e-05 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041715+0000", 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1744e-05 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041723+0000", 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1980000000000001e-06 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041837+0000", 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011389500000000001 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041849+0000", 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2441e-05 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.043929+0000", 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002079245 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.043971+0000", 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1925999999999998e-05 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.360 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.047783+0000", 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.269922212000001, 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038371149999999999, 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047783+0000", 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047783+0000", 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047783+0000", 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3699999999999999e-07 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047817+0000", 2024-04-26T02:24:21.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3626e-05 2024-04-26T02:24:21.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047839+0000", 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1900999999999999e-05 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047851+0000", 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2656e-05 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047904+0000", 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2816999999999999e-05 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.047911+0000", 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8090000000000004e-06 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.051572+0000", 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036609519999999999 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.051620+0000", 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8117e-05 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.365 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 38/31 ECSubWrite(tid=50, reqid=osd.12.0:48, at_version=0'0, trim_to=0'0, roll_forward_to=38'21))", 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.053544+0000", 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.264160546999999, 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063140849999999997, 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053544+0000", 2024-04-26T02:24:21.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053544+0000", 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053546+0000", 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.068e-06 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053565+0000", 2024-04-26T02:24:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9054000000000001e-05 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053587+0000", 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2215999999999999e-05 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053601+0000", 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4548e-05 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053706+0000", 2024-04-26T02:24:21.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104675 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053724+0000", 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7558999999999999e-05 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.059795+0000", 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060717690000000003 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.059859+0000", 2024-04-26T02:24:21.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3195999999999996e-05 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 38/31 ECSubWrite(tid=51, reqid=osd.12.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.055152+0000", 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.262552783, 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052642050000000001, 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.370 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055152+0000", 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055152+0000", 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055153+0000", 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1500000000000004e-07 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055180+0000", 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6981000000000001e-05 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055190+0000", 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0026e-05 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055198+0000", 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8080000000000005e-06 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055275+0000", 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7089999999999995e-05 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.055284+0000", 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1360000000000003e-06 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.060374+0000", 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0050901480000000001 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.060416+0000", 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2401000000000003e-05 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 38/31 ECSubWrite(tid=38, reqid=osd.13.0:38, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.056553+0000", 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.261151876, 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038501410000000001, 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056553+0000", 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056553+0000", 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056554+0000", 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9900000000000009e-07 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056591+0000", 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6727999999999998e-05 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056610+0000", 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9391000000000001e-05 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056621+0000", 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1007e-05 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056920+0000", 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029854000000000002 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056936+0000", 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6595e-05 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.060349+0000", 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003412605 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.060403+0000", 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4276e-05 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.378 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 38/31 ECSubWrite(tid=39, reqid=osd.13.0:34, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.061737+0000", 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.255968434, 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003619658, 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061737+0000", 2024-04-26T02:24:21.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061737+0000", 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061738+0000", 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0690000000000001e-06 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061750+0000", 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.271e-05 2024-04-26T02:24:21.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061767+0000", 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6591000000000001e-05 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061776+0000", 2024-04-26T02:24:21.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3929999999999997e-06 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061857+0000", 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0189000000000001e-05 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.061867+0000", 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0613e-05 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.065313+0000", 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034459500000000001 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.065356+0000", 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3142999999999997e-05 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 42/31 ECSubWrite(tid=68, reqid=client.4589.0:256, at_version=42'22, trim_to=0'0, roll_forward_to=38'21))", 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.092274+0000", 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.225430709999999, 2024-04-26T02:24:21.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022982329999999998, 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092274+0000", 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092274+0000", 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092275+0000", 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8999999999999995e-07 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092323+0000", 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7964999999999999e-05 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092373+0000", 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9354999999999998e-05 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.385 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092402+0000", 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9468999999999999e-05 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092573+0000", 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017099800000000001 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092599+0000", 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5882999999999999e-05 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.094484+0000", 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001885589 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.094573+0000", 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8084000000000006e-05 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 42/31 ECSubWrite(tid=69, reqid=client.4589.0:256, at_version=0'0, trim_to=0'0, roll_forward_to=42'22))", 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.097062+0000", 2024-04-26T02:24:21.387 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.220643286, 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023386380000000001, 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097062+0000", 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097062+0000", 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097064+0000", 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0329999999999998e-06 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097092+0000", 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8592e-05 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097123+0000", 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0828999999999999e-05 2024-04-26T02:24:21.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097144+0000", 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1282999999999999e-05 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097293+0000", 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000148162 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.097317+0000", 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4256e-05 2024-04-26T02:24:21.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.099306+0000", 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019895889999999999 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.099400+0000", 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3894000000000006e-05 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.391 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "pg_update_log_missing(3.es3 epoch 42/31 rep_tid 59 entries 42'14 (0'0) error 3:7ba9a40e:::smithi17529564-23:head by client.4589.0:267 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 38'12)", 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.134104+0000", 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.183600607000001, 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002645409, 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.134104+0000", 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.134104+0000", 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.134106+0000", 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2270000000000001e-06 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.134124+0000", 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8675999999999999e-05 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.134175+0000", 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0281999999999997e-05 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.134218+0000", 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3492000000000003e-05 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.134439+0000", 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000221067 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.136750+0000", 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023106649999999999 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 47/31 ECSubWrite(tid=27, reqid=osd.11.0:27, at_version=47'19, trim_to=0'0, roll_forward_to=45'17))", 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:14.978667+0000", 2024-04-26T02:24:21.395 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.3390382220000001, 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0044152849999999997, 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978667+0000", 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978667+0000", 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978668+0000", 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4000000000000001e-07 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978725+0000", 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7116e-05 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978757+0000", 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2271999999999999e-05 2024-04-26T02:24:21.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978780+0000", 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3006e-05 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978977+0000", 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000196658 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.979004+0000", 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7579000000000001e-05 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983009+0000", 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040052890000000004 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983082+0000", 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2625000000000003e-05 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.399 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 47/31 ECSubWrite(tid=28, reqid=osd.11.0:27, at_version=0'0, trim_to=0'0, roll_forward_to=47'19))", 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:14.984128+0000", 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.3335765899999998, 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035270829999999999, 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984128+0000", 2024-04-26T02:24:21.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984128+0000", 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984130+0000", 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0470000000000001e-06 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984159+0000", 2024-04-26T02:24:21.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8089000000000002e-05 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984197+0000", 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8346000000000002e-05 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984220+0000", 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2631999999999999e-05 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984379+0000", 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015949000000000001 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.984404+0000", 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4575000000000001e-05 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.987585+0000", 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031814090000000001 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.987656+0000", 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0494999999999995e-05 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 48/31 ECSubWrite(tid=80, reqid=osd.12.0:80, at_version=48'31, trim_to=0'0, roll_forward_to=47'29))", 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.511750+0000", 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.8059554689999997, 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029177909999999999, 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.406 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.511750+0000", 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.511750+0000", 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.511751+0000", 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.24e-06 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.511846+0000", 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5537000000000004e-05 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.511928+0000", 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1402000000000004e-05 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.511962+0000", 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4764999999999997e-05 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.512127+0000", 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016484299999999999 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.512139+0000", 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1703e-05 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.514635+0000", 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002495503 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.514667+0000", 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2798e-05 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 48/31 ECSubWrite(tid=81, reqid=osd.12.0:80, at_version=0'0, trim_to=0'0, roll_forward_to=48'31))", 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.520486+0000", 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.7972193220000001, 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036681190000000001, 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.410 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520486+0000", 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520486+0000", 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520488+0000", 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.877e-06 2024-04-26T02:24:21.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520512+0000", 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4502e-05 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520539+0000", 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.688e-05 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520611+0000", 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1735000000000004e-05 2024-04-26T02:24:21.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520792+0000", 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018164200000000001 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.520814+0000", 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1243999999999999e-05 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.524076+0000", 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032623790000000001 2024-04-26T02:24:21.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.524154+0000", 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7860000000000003e-05 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.414 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:21.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:24:21.416 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:21.412+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:21.516 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-04-26T02:24:21.517 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T02:24:21.517 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:21.512+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:21.523 INFO:tasks.rados.rados.0.smithi175.stdout:144: done (0 left) 2024-04-26T02:24:21.523 INFO:tasks.rados.rados.0.smithi175.stdout:145: snap_remove snap 9 2024-04-26T02:24:21.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T02:24:21.592 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:21.592 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:21.592 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:21.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:24:21.618 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:21.614+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:21.719 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:21.716+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:21.769 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:21.769 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:21.770 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:21.770 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:21.770 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:21.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:24:21.820 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:21.820+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:21.914 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:21.914 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:21.914 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:21.914 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:21.914 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:197 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~589824] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.852381703999999, 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01132682, 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 197 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.915 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058678+0000", 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1119999999999999e-06 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.916 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059820+0000", 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011419329999999999 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059838+0000", 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7312e-05 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059849+0000", 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1066999999999999e-05 2024-04-26T02:24:21.917 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060084+0000", 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023474499999999999 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060231+0000", 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014785699999999999 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061250+0000", 2024-04-26T02:24:21.918 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00101822 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.063642+0000", 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00239267 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069912+0000", 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006269546 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.919 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070003+0000", 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1358000000000002e-05 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:198 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~376832] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064330+0000", 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.846728018, 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070653950000000004, 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.920 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 198 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064330+0000", 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064330+0000", 2024-04-26T02:24:21.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064332+0000", 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9400000000000001e-06 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064739+0000", 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00040711300000000002 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064751+0000", 2024-04-26T02:24:21.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1963e-05 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064761+0000", 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.039e-05 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064849+0000", 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7519e-05 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064990+0000", 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014100399999999999 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.066057+0000", 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001067094 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069765+0000", 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037077049999999999 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071333+0000", 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001568255 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071395+0000", 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2411999999999998e-05 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.925 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:199 3.5s0 3:a5f188bf:::smithi17529564-38:head [setxattr _header (56) in=7b] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064776+0000", 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.846282054, 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072726609999999997, 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 199 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064776+0000", 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064776+0000", 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064777+0000", 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7499999999999999e-07 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064780+0000", 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5870000000000001e-06 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064793+0000", 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2836e-05 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064797+0000", 2024-04-26T02:24:21.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.613e-06 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.066888+0000", 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020912869999999998 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067018+0000", 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012998600000000001 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067648+0000", 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00063017399999999995 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070033+0000", 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023843100000000002 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.071957+0000", 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001924006 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072049+0000", 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2087000000000001e-05 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:200 3.5s0 3:a5f188bf:::smithi17529564-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.846226036000001, 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094044490000000005, 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.931 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 200 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7700000000000005e-07 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064835+0000", 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6929999999999999e-06 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064844+0000", 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1919999999999994e-06 2024-04-26T02:24:21.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064850+0000", 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0610000000000001e-06 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068037+0000", 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031864490000000001 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068091+0000", 2024-04-26T02:24:21.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4273e-05 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072664+0000", 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004572932 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072801+0000", 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013716100000000001 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.074236+0000", 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001435211 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:255 3.5s0 3:a9520d7f:::smithi17529564-15:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.071948+0000", 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.839109743, 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087410590000000007, 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 255 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071948+0000", 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071948+0000", 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071951+0000", 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6469999999999998e-06 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071963+0000", 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2516e-05 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071996+0000", 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2054999999999997e-05 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072017+0000", 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1263999999999998e-05 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.073247+0000", 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001230678 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.073535+0000", 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028712799999999999 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.075011+0000", 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014760649999999999 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.077188+0000", 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002177567 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.080453+0000", 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032644029999999999 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.080689+0000", 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000236736 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:265 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.133207+0000", 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.777851298, 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085180510000000004, 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.942 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 265 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133207+0000", 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133207+0000", 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133208+0000", 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7060000000000001e-06 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133220+0000", 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1070000000000001e-05 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133245+0000", 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5476000000000001e-05 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133266+0000", 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1426000000000001e-05 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.136719+0000", 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034528039999999999 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.136949+0000", 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000229836 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.141725+0000", 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047757329999999999 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:266 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.777763278, 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015257379, 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.946 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 266 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133296+0000", 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.313e-06 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133306+0000", 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4469999999999995e-06 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133328+0000", 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2439e-05 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133371+0000", 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2571999999999998e-05 2024-04-26T02:24:21.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.141874+0000", 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085034459999999996 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142095+0000", 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000220996 2024-04-26T02:24:21.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.148552+0000", 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064571660000000003 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:271 3.5s0 3:a9520d7f:::smithi17529564-15:head [create,setxattr ]ScjNOsReWmcrsXtQckiNfVsraic]liXUgaZfrPb (12280) in=40b,setxattr RP^fql]PXPbbV]`\\UXhZUcc\\s\\eVVh]On^oUhNgZ (593) in=40b,setxattr ejajVrghj]sk_[VhasYoUSNhlO_PNopbXh\\iYad\\ (1963) in=40b,setxattr ocopbYhpUShgXjpVTtXhgrZ^fhTrWUZnka_sOlQ] (1506) in=40b,setxattr drSfWQp[TZZaai[S^\\ecpepRjetPTZ[Qn[slVhsn (1437) in=40b,setxattr qfWkbgV_hlqXWl`QOe]pOPUPZspbtU__NVPUUltj (877) in=40b,setxattr ]Vrng_\\anafncgktlQh_okb\\i]chR]P]jeoaR\\h] (1858) in=40b,setxattr ]W_abhUq]ocdkOt[ZkpjgPX^drZi]OcUWNRonRa\\ (455) in=40b,setxattr WiZeSWPfsqgYXk`d\\gOeSecbpakdsPTXZfZhn_k^ (875) in=40b,setxattr kqn^akbbamUTRXRhQS^i`lQYomhV_P`j\\ahTj]dk (1894) in=40b,setxattr TUcrapOXk_aZjTSdOT`rYcU_YYstnVgNTojk`lXZ (805) in=40b,setxattr a`RfekoeadQgiYossXre`rV^qNeUNiNf\\lSXhohq (15648) in=40b,setxattr VigYdf[rkVcbX`_aXcZrljeilZZV\\O[gpOhof]\\P (1473) in=40b,setxattr Qrfl^hc[_sp[p`bcN[Ne\\tg^]rgrOlRqfQ_VWNt\\ (1261) in=40b,setxattr iQVqR\\bssbQRQf^a`UrVROfgpPZlnstjPUaUnWWt (665) in=40b,setxattr aO^mjdTNk[qYOgYsgTigbbP`]mhe`WmaNUO[^ele (979) in=40b,setxattr cfQeZUernkePqgPcSrokkcnPqZ^Osc^^ng[ilga_ (16840) in=40b,setxattr fdbVa_]fdVq_`kcpaWlQSgY^VgakSqVhj`qqdj[m (1858) in=40b,setxattr tXieTi_TgP_dVipjmQcU_QVRqNdboYhRWgNrpVhm (1858) in=40b,setxattr ]YTcidkg\\][ZtajYPqmOji_UPVPZ`j^]tnNRefcd (2876) in=40b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.141531+0000", 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.769526871, 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077990339999999998, 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.951 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 271 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.141531+0000", 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.141531+0000", 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.141538+0000", 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1629999999999999e-06 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142730+0000", 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011915039999999999 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142773+0000", 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2728999999999997e-05 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142795+0000", 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2733000000000001e-05 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.143319+0000", 2024-04-26T02:24:21.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00052360700000000004 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.143570+0000", 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025078500000000001 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.145279+0000", 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001708995 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.147409+0000", 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021301110000000001 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.149198+0000", 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001789571 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.149330+0000", 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131836 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:281 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~524288] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.742126578000001, 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019327321000000001, 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.957 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 281 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168934+0000", 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4839999999999998e-06 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170027+0000", 2024-04-26T02:24:21.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010934390000000001 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170064+0000", 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6295999999999999e-05 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170083+0000", 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8958999999999999e-05 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170253+0000", 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017040499999999999 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170531+0000", 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027794499999999998 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.172686+0000", 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021548629999999999 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174338+0000", 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00165226 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188107+0000", 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013769366999999999 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188259+0000", 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015130300000000001 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:282 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~524288] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.737774848000001, 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015341766, 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.963 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 282 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173286+0000", 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3700000000000002e-06 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174448+0000", 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011628610000000001 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174480+0000", 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1356000000000003e-05 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174494+0000", 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4462e-05 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174626+0000", 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000132216 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174882+0000", 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000255429 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.176676+0000", 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017945190000000001 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186967+0000", 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010290597 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188445+0000", 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001478441 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188625+0000", 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017951499999999999 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:283 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~245760] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.736058884, 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014380792, 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 283 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.969 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175001+0000", 2024-04-26T02:24:21.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1840000000000002e-06 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175369+0000", 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000367525 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175391+0000", 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2149000000000001e-05 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175404+0000", 2024-04-26T02:24:21.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3293e-05 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178383+0000", 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029786449999999998 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178546+0000", 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016274200000000001 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180029+0000", 2024-04-26T02:24:21.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014829209999999999 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187286+0000", 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072569109999999996 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.189276+0000", 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019904459999999999 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.189380+0000", 2024-04-26T02:24:21.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103976 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:284 3.5s0 3:a5f188bf:::smithi17529564-38:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.735628833, 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014822755, 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.974 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 284 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175430+0000", 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2500000000000001e-06 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175437+0000", 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7429999999999996e-06 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175449+0000", 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1426e-05 2024-04-26T02:24:21.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175457+0000", 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4130000000000006e-06 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181434+0000", 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059764500000000003 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181694+0000", 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026069800000000002 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186398+0000", 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047033689999999998 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187751+0000", 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013529480000000001 2024-04-26T02:24:21.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190099+0000", 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023486190000000001 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190252+0000", 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015283899999999999 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:285 3.5s0 3:a5f188bf:::smithi17529564-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.735588535, 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019577975000000001, 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 285 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6700000000000003e-07 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175496+0000", 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5456000000000002e-05 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175509+0000", 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3039e-05 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175521+0000", 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2597e-05 2024-04-26T02:24:21.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190996+0000", 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015474141 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.191226+0000", 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023018999999999999 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195047+0000", 2024-04-26T02:24:21.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038217849999999999 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.178628+0000", 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.732430491000001, 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085186810000000002, 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178628+0000", 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178628+0000", 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178629+0000", 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.64e-06 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178638+0000", 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5599999999999994e-06 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178661+0000", 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3442e-05 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178675+0000", 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3482000000000001e-05 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187091+0000", 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084160720000000001 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187146+0000", 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5485000000000002e-05 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.987 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.178801+0000", 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.732256596999999, 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084871029999999993, 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178801+0000", 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178801+0000", 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178803+0000", 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4959999999999999e-06 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178812+0000", 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1269999999999992e-06 2024-04-26T02:24:21.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178837+0000", 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4969000000000001e-05 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178849+0000", 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2417e-05 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187254+0000", 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084042349999999995 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187289+0000", 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4858999999999999e-05 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179110+0000", 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.73194833, 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083467139999999999, 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179110+0000", 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179110+0000", 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179111+0000", 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6300000000000001e-06 2024-04-26T02:24:21.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179123+0000", 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1503e-05 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179152+0000", 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9419000000000001e-05 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179172+0000", 2024-04-26T02:24:21.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9366000000000001e-05 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187402+0000", 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082299339999999995 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187456+0000", 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4861999999999998e-05 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179364+0000", 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.731694508, 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083906659999999997, 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179364+0000", 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179364+0000", 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179365+0000", 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3939999999999999e-06 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179385+0000", 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0346000000000001e-05 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179415+0000", 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0185e-05 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179451+0000", 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5076000000000001e-05 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187706+0000", 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082557129999999996 2024-04-26T02:24:21.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187754+0000", 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7951999999999998e-05 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179371+0000", 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.731686971, 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008252456, 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:21.999 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179371+0000", 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179371+0000", 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179373+0000", 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7370000000000001e-06 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179381+0000", 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6600000000000001e-06 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179402+0000", 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0262e-05 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179413+0000", 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1651000000000001e-05 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187566+0000", 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081526810000000002 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187624+0000", 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7465e-05 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.002 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=50, last_complete=42'38, committed=1, applied=1))", 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179477+0000", 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.731581093999999, 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088159789999999998, 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179477+0000", 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179477+0000", 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179479+0000", 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7799999999999999e-06 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179490+0000", 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1539000000000001e-05 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179520+0000", 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9879e-05 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179540+0000", 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9979999999999998e-05 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187823+0000", 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082831750000000003 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188293+0000", 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00046962600000000001 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.006 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.731486124, 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.009074291, 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179573+0000", 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179579+0000", 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5030000000000002e-06 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179612+0000", 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3361999999999997e-05 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179631+0000", 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.819e-05 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188340+0000", 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087091149999999999 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188646+0000", 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030643400000000001 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.010 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:22.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:24:22.012 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:22.010+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:22.113 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:22.110+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:22.144 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:22.144 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:22.144 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:22.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:24:22.214 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:22.214+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:22.282 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:22.283 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:22.283 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:22.283 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:22.283 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:22.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:24:22.315 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:22.314+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:22.417 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.376418170000001, 2024-04-26T02:24:22.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043860330000000001, 2024-04-26T02:24:22.418 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.418 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.418 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.418 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039532+0000", 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2300000000000002e-07 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039557+0000", 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4723999999999999e-05 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039573+0000", 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5540999999999999e-05 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039584+0000", 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1505000000000001e-05 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039717+0000", 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013328799999999999 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.039746+0000", 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8279000000000001e-05 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043829+0000", 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040835460000000004 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.043918+0000", 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8826999999999995e-05 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.375316867999999, 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070939660000000002, 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.422 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040634+0000", 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1800000000000005e-07 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040658+0000", 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3377999999999999e-05 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040673+0000", 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5376999999999999e-05 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040683+0000", 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0446e-05 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040733+0000", 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0002e-05 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040740+0000", 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2210000000000002e-06 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047581+0000", 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068417319999999997 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047727+0000", 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014599200000000001 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 37/31 ECSubWrite(tid=13, reqid=osd.15.0:13, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.368487159000001, 2024-04-26T02:24:22.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023542559999999999, 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047463+0000", 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5699999999999998e-07 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047493+0000", 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9451e-05 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047509+0000", 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5984000000000001e-05 2024-04-26T02:24:22.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047520+0000", 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1245e-05 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047677+0000", 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015684499999999999 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047700+0000", 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3376000000000001e-05 2024-04-26T02:24:22.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.049768+0000", 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020678770000000001 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.049817+0000", 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9120999999999999e-05 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=65, reqid=osd.0.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:22.430 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.056126+0000", 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.359824048, 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024618159999999999, 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056126+0000", 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056126+0000", 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056129+0000", 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3499999999999999e-06 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056159+0000", 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0039000000000002e-05 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056194+0000", 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5296000000000002e-05 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056238+0000", 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3671000000000003e-05 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056339+0000", 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000101452 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056348+0000", 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6039999999999993e-06 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058533+0000", 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002185541 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058588+0000", 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4863e-05 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.434 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 37/31 ECSubWrite(tid=14, reqid=osd.15.0:13, at_version=0'0, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.056158+0000", 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.359792369000001, 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023927570000000001, 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056158+0000", 2024-04-26T02:24:22.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056158+0000", 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056159+0000", 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.178e-06 2024-04-26T02:24:22.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056172+0000", 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2653999999999999e-05 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056192+0000", 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0469999999999999e-05 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056204+0000", 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1418e-05 2024-04-26T02:24:22.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056322+0000", 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011858600000000001 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.056333+0000", 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1046000000000001e-05 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058503+0000", 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021693319999999999 2024-04-26T02:24:22.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058551+0000", 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8072999999999999e-05 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:201 3.ds0 3:bba78641:::smithi17529564-30:head [stat,delete] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 17.351343866000001, 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006036591, 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.440 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 201 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064608+0000", 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.826e-06 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064617+0000", 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8799999999999997e-06 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064634+0000", 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6495999999999999e-05 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064641+0000", 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8520000000000004e-06 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064728+0000", 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6112999999999994e-05 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:22.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064856+0000", 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000128734 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065756+0000", 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089999800000000005 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067196+0000", 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014399969999999999 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070552+0000", 2024-04-26T02:24:22.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033559589999999999 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070643+0000", 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0736000000000007e-05 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.041328+0000", 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.374622334000001, 2024-04-26T02:24:22.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041083710000000004, 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041328+0000", 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041328+0000", 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041329+0000", 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5799999999999998e-07 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041352+0000", 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.279e-05 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041365+0000", 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.312e-05 2024-04-26T02:24:22.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.041373+0000", 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4069999999999993e-06 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.042069+0000", 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00069537400000000001 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.042078+0000", 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9510000000000001e-06 2024-04-26T02:24:22.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.045398+0000", 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033194729999999999 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.045436+0000", 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8297999999999998e-05 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 38/31 ECSubWrite(tid=69, reqid=osd.0.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:22.449 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.056992+0000", 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.358958272999999, 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003546488, 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056992+0000", 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056992+0000", 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.056992+0000", 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1199999999999998e-07 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.057002+0000", 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8670000000000006e-06 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.451 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.057012+0000", 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0105999999999999e-05 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.057021+0000", 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1349999999999998e-06 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.057139+0000", 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011725700000000001 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.057148+0000", 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2040000000000003e-06 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.060503+0000", 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003355107 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.060538+0000", 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.54e-05 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:256 3.as0 3:5c6c7353:::smithi17529564-29:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.334814743000001, 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014402701, 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 256 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081140+0000", 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2930000000000002e-06 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081191+0000", 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1569e-05 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081233+0000", 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2070999999999998e-05 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081259+0000", 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5570000000000001e-05 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.456 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081495+0000", 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000236269 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081510+0000", 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4593000000000001e-05 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089249+0000", 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077387760000000002 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089530+0000", 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028140800000000003 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.091455+0000", 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001924947 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.093895+0000", 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002439662 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.095340+0000", 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001445436 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.095538+0000", 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019810699999999999 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:263 3.ds0 3:ba38dc4c:::smithi17529564-14:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:22.459 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.127184+0000", 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.288765941999999, 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055141340000000004, 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 263 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127184+0000", 2024-04-26T02:24:22.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127184+0000", 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127187+0000", 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.943e-06 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127197+0000", 2024-04-26T02:24:22.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0132999999999999e-05 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127227+0000", 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9385000000000001e-05 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127242+0000", 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5696999999999999e-05 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127391+0000", 2024-04-26T02:24:22.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014879199999999999 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.127547+0000", 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000155449 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.128512+0000", 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00096568999999999995 2024-04-26T02:24:22.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.131345+0000", 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028326860000000001 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132497+0000", 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011522520000000001 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132698+0000", 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020110700000000001 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.464 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 42/31 ECSubWrite(tid=19, reqid=client.4589.0:259, at_version=42'14, trim_to=0'0, roll_forward_to=42'13))", 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.128499+0000", 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.287450866, 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003638432, 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.128499+0000", 2024-04-26T02:24:22.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.128499+0000", 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.128501+0000", 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4270000000000001e-06 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.466 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.128912+0000", 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00041078700000000002 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.128940+0000", 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8768999999999998e-05 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.128963+0000", 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2373000000000001e-05 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.467 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129117+0000", 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000154532 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129144+0000", 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7061999999999999e-05 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132031+0000", 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028866149999999999 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132138+0000", 2024-04-26T02:24:22.468 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010686700000000001 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 42/31 ECSubWrite(tid=20, reqid=client.4589.0:260, at_version=42'15, trim_to=0'0, roll_forward_to=42'13))", 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.129111+0000", 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.286838745000001, 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037675909999999998, 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.469 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129111+0000", 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129111+0000", 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129113+0000", 2024-04-26T02:24:22.470 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.33e-06 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129169+0000", 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6548999999999997e-05 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129198+0000", 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9115000000000002e-05 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129219+0000", 2024-04-26T02:24:22.471 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0953000000000001e-05 2024-04-26T02:24:22.472 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:22.412+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.130420+0000", 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012003129999999999 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.130446+0000", 2024-04-26T02:24:22.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5829999999999998e-05 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132815+0000", 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023692729999999999 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132879+0000", 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4227999999999996e-05 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 42/31 ECSubWrite(tid=21, reqid=client.4589.0:261, at_version=42'16, trim_to=0'0, roll_forward_to=42'13))", 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.129998+0000", 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.285952169, 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029238570000000002, 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129998+0000", 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.129998+0000", 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.130000+0000", 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2929999999999999e-06 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.130041+0000", 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1009e-05 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.130074+0000", 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2996000000000001e-05 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.130097+0000", 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2442999999999998e-05 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.131223+0000", 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001126099 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.131247+0000", 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4025000000000001e-05 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132885+0000", 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016382739999999999 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.132922+0000", 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6718000000000003e-05 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.478 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 42/31 ECSubWrite(tid=26, reqid=client.4589.0:273, at_version=42'18, trim_to=0'0, roll_forward_to=42'17))", 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.158611+0000", 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.257338953, 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021116590000000001, 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.158611+0000", 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.158611+0000", 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.158613+0000", 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.793e-06 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.158836+0000", 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022277000000000001 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.158868+0000", 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2552999999999998e-05 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.158896+0000", 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7702e-05 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.159027+0000", 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131216 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.159042+0000", 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5038999999999999e-05 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160654+0000", 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001611241 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160723+0000", 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9344999999999994e-05 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 42/31 ECSubWrite(tid=27, reqid=client.4589.0:274, at_version=42'19, trim_to=0'0, roll_forward_to=42'17))", 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.160794+0000", 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 12.25515641, 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002303809, 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.483 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160794+0000", 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160794+0000", 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160795+0000", 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0669999999999999e-06 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160827+0000", 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1856000000000001e-05 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160852+0000", 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5299e-05 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.160869+0000", 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7299000000000002e-05 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.161007+0000", 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013788599999999999 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.161037+0000", 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0102000000000001e-05 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.163030+0000", 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019922160000000002 2024-04-26T02:24:22.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.163098+0000", 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8083999999999994e-05 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 47/31 ECSubWrite(tid=36, reqid=osd.15.0:36, at_version=47'26, trim_to=0'0, roll_forward_to=46'24))", 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:14.978746+0000", 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.4372043650000004, 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022009719999999998, 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.487 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978746+0000", 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978746+0000", 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978747+0000", 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7299999999999995e-07 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978804+0000", 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7948000000000002e-05 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978838+0000", 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3979000000000001e-05 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.978862+0000", 2024-04-26T02:24:22.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3666999999999999e-05 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.979053+0000", 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019060799999999999 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.979085+0000", 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1888999999999999e-05 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.980872+0000", 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017874830000000001 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.980947+0000", 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4725e-05 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 47/31 ECSubWrite(tid=37, reqid=osd.15.0:36, at_version=0'0, trim_to=0'0, roll_forward_to=47'26))", 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:14.983554+0000", 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 7.4323958689999996, 2024-04-26T02:24:22.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038067349999999999, 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983554+0000", 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983554+0000", 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983557+0000", 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5170000000000002e-06 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983583+0000", 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6519000000000001e-05 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983610+0000", 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6973000000000001e-05 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983626+0000", 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5603e-05 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983778+0000", 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015189500000000001 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.983806+0000", 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.813e-05 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.987264+0000", 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034576210000000001 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:14.987361+0000", 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7477000000000002e-05 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 48/31 ECSubWrite(tid=39, reqid=osd.15.0:38, at_version=0'0, trim_to=0'0, roll_forward_to=48'28))", 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.513902+0000", 2024-04-26T02:24:22.495 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.9020480720000004, 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060962789999999996, 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513902+0000", 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513902+0000", 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513903+0000", 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1699999999999997e-07 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513914+0000", 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1537e-05 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513927+0000", 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2099000000000001e-05 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513934+0000", 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4610000000000002e-06 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513984+0000", 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9975000000000002e-05 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513993+0000", 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7590000000000003e-06 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.519938+0000", 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005944881 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.519998+0000", 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0850000000000002e-05 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.499 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 49/31 ECSubWrite(tid=96, reqid=client.4589.0:332, at_version=49'35, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.489866+0000", 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.9260839509999998, 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003795629, 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489866+0000", 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489866+0000", 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489867+0000", 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7300000000000005e-07 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489961+0000", 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3981999999999996e-05 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489997+0000", 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6001999999999999e-05 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.490023+0000", 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5536000000000001e-05 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.490286+0000", 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026364299999999998 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.490332+0000", 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5358999999999997e-05 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.493554+0000", 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032223629999999998 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.493662+0000", 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000107971 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 49/31 ECSubWrite(tid=100, reqid=client.4589.0:333, at_version=49'36, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.494355+0000", 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 5.9215948990000005, 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033797559999999998, 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494355+0000", 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494355+0000", 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494357+0000", 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9599999999999999e-06 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494410+0000", 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2643999999999999e-05 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494481+0000", 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1094999999999996e-05 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494505+0000", 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4176999999999999e-05 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.495390+0000", 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00088526999999999996 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.495415+0000", 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4032999999999998e-05 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497646+0000", 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022319359999999999 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497735+0000", 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8640999999999994e-05 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:22.508 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:22.508 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:22.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:24:22.509 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T02:24:22.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T02:24:22.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:22.511 INFO:tasks.rados.rados.0.smithi175.stdout:145: done (0 left) 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:146: read oid 8 snap 11 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:146: expect (ObjNum 51 snap 2 seq_num 51) 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:147: read oid 33 snap -1 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:147: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:148: rmattr oid 25 current snap is 12 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:148: done (2 left) 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 13 current snap is 12 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:149: seq_num 86 ranges {212992=688128,901120=540672,1441792=229376} 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:149: writing smithi17529564-13 from 212992 to 901120 tid 1 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:149: writing smithi17529564-13 from 901120 to 1441792 tid 2 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:149: writing smithi17529564-13 from 1441792 to 1671168 tid 3 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:150: read oid 46 snap -1 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:150: expect (ObjNum 84 snap 9 seq_num 84) 2024-04-26T02:24:22.512 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 26 current snap is 12 2024-04-26T02:24:22.513 INFO:tasks.rados.rados.0.smithi175.stdout:151: seq_num 87 ranges {1376256=704512,2080768=688128,2768896=81920} 2024-04-26T02:24:22.525 INFO:tasks.rados.rados.0.smithi175.stdout:151: writing smithi17529564-26 from 1376256 to 2080768 tid 1 2024-04-26T02:24:22.532 INFO:tasks.rados.rados.0.smithi175.stdout:151: writing smithi17529564-26 from 2080768 to 2768896 tid 2 2024-04-26T02:24:22.533 INFO:tasks.rados.rados.0.smithi175.stdout:151: writing smithi17529564-26 from 2768896 to 2850816 tid 3 2024-04-26T02:24:22.533 INFO:tasks.rados.rados.0.smithi175.stdout:152: setattr oid 47 current snap is 12 2024-04-26T02:24:22.533 INFO:tasks.rados.rados.0.smithi175.stdout:147: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:24:22.555 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:22.552+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:22.557 INFO:tasks.rados.rados.0.smithi175.stdout:146: expect (ObjNum 51 snap 2 seq_num 51) 2024-04-26T02:24:22.600 INFO:tasks.rados.rados.0.smithi175.stdout:149: finishing write tid 1 to smithi17529564-13 2024-04-26T02:24:22.600 INFO:tasks.rados.rados.0.smithi175.stdout:149: finishing write tid 2 to smithi17529564-13 2024-04-26T02:24:22.600 INFO:tasks.rados.rados.0.smithi175.stdout:149: finishing write tid 3 to smithi17529564-13 2024-04-26T02:24:22.601 INFO:tasks.rados.rados.0.smithi175.stdout:149: finishing write tid 4 to smithi17529564-13 2024-04-26T02:24:22.601 INFO:tasks.rados.rados.0.smithi175.stdout:150: expect (ObjNum 84 snap 9 seq_num 84) 2024-04-26T02:24:22.618 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:22.616+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:22.644 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:22.644 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:22.644 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:22.644 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:22.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:24:22.699 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:22.700 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:22.716 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:22.717 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:22.719 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:22.712+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:22.722 INFO:tasks.rados.rados.0.smithi175.stdout:149: finishing write tid 5 to smithi17529564-13 2024-04-26T02:24:22.722 INFO:tasks.rados.rados.0.smithi175.stdout:149: oid 13 updating version 0 to 48 2024-04-26T02:24:22.722 INFO:tasks.rados.rados.0.smithi175.stdout:149: oid 13 updating version 48 to 49 2024-04-26T02:24:22.722 INFO:tasks.rados.rados.0.smithi175.stdout:149: oid 13 version 49 is already newer than 47 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:149: oid 13 updating version 49 to 50 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 13 v 50 (ObjNum 86 snap 12 seq_num 86) dirty exists 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:149: left oid 13 (ObjNum 86 snap 12 seq_num 86) 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: finishing write tid 1 to smithi17529564-26 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: finishing write tid 2 to smithi17529564-26 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: finishing write tid 3 to smithi17529564-26 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: finishing write tid 4 to smithi17529564-26 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: finishing write tid 5 to smithi17529564-26 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: oid 26 updating version 0 to 36 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: oid 26 version 36 is already newer than 34 2024-04-26T02:24:22.723 INFO:tasks.rados.rados.0.smithi175.stdout:151: oid 26 version 36 is already newer than 35 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:151: oid 26 version 36 is already newer than 33 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 26 v 36 (ObjNum 87 snap 12 seq_num 87) dirty exists 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:151: left oid 26 (ObjNum 87 snap 12 seq_num 87) 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:146: done (5 left) 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:147: done (4 left) 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:149: done (3 left) 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:150: done (2 left) 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:151: done (1 left) 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:153: copy_from oid 15 from oid 1 current snap is 12 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:154: copy_from oid 43 from oid 17 current snap is 12 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 46 current snap is 12 2024-04-26T02:24:22.724 INFO:tasks.rados.rados.0.smithi175.stdout:155: seq_num 88 ranges {3096576=720896,3817472=442368,4259840=327680} 2024-04-26T02:24:22.741 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:22.741 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:22.754 INFO:tasks.rados.rados.0.smithi175.stdout:155: writing smithi17529564-46 from 3096576 to 3817472 tid 1 2024-04-26T02:24:22.758 INFO:tasks.rados.rados.0.smithi175.stdout:155: writing smithi17529564-46 from 3817472 to 4259840 tid 2 2024-04-26T02:24:22.761 INFO:tasks.rados.rados.0.smithi175.stdout:155: writing smithi17529564-46 from 4259840 to 4587520 tid 3 2024-04-26T02:24:22.761 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 23 current snap is 12 2024-04-26T02:24:22.761 INFO:tasks.rados.rados.0.smithi175.stdout:156: seq_num 89 ranges {0=737280,737280=573440,1310720=196608} 2024-04-26T02:24:22.764 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:22.768 INFO:tasks.rados.rados.0.smithi175.stdout:156: writing smithi17529564-23 from 0 to 737280 tid 1 2024-04-26T02:24:22.773 INFO:tasks.rados.rados.0.smithi175.stdout:156: writing smithi17529564-23 from 737280 to 1310720 tid 2 2024-04-26T02:24:22.776 INFO:tasks.rados.rados.0.smithi175.stdout:156: writing smithi17529564-23 from 1310720 to 1507328 tid 3 2024-04-26T02:24:22.776 INFO:tasks.rados.rados.0.smithi175.stdout:157: rmattr oid 18 current snap is 12 2024-04-26T02:24:22.776 INFO:tasks.rados.rados.0.smithi175.stdout:157: done (5 left) 2024-04-26T02:24:22.776 INFO:tasks.rados.rados.0.smithi175.stdout:158: rollback oid 3 current snap is 12 2024-04-26T02:24:22.776 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 3 to 10 2024-04-26T02:24:22.776 INFO:tasks.rados.rados.0.smithi175.stdout:154: finishing copy_from to smithi17529564-43 2024-04-26T02:24:22.777 INFO:tasks.rados.rados.0.smithi175.stdout:154: got expected ENOENT (src dne) 2024-04-26T02:24:22.777 INFO:tasks.rados.rados.0.smithi175.stdout:159: read oid 2 snap 11 2024-04-26T02:24:22.777 INFO:tasks.rados.rados.0.smithi175.stdout:159: expect (ObjNum 1 snap 0 seq_num 1) 2024-04-26T02:24:22.777 INFO:tasks.rados.rados.0.smithi175.stdout:160: delete oid 27 current snap is 12 2024-04-26T02:24:22.777 INFO:tasks.rados.rados.0.smithi175.stdout:154: finishing copy_from racing read to smithi17529564-43 2024-04-26T02:24:22.777 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 38 (ObjNum 46 snap 0 seq_num 46) dirty exists 2024-04-26T02:24:22.778 INFO:tasks.rados.rados.0.smithi175.stdout:153: finishing copy_from racing read to smithi17529564-15 2024-04-26T02:24:22.778 INFO:tasks.rados.rados.0.smithi175.stdout:153: finishing copy_from to smithi17529564-15 2024-04-26T02:24:22.778 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 15 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2024-04-26T02:24:22.778 INFO:tasks.rados.rados.0.smithi175.stdout:155: finishing write tid 1 to smithi17529564-46 2024-04-26T02:24:22.778 INFO:tasks.rados.rados.0.smithi175.stdout:155: finishing write tid 2 to smithi17529564-46 2024-04-26T02:24:22.778 INFO:tasks.rados.rados.0.smithi175.stdout:155: finishing write tid 3 to smithi17529564-46 2024-04-26T02:24:22.779 INFO:tasks.rados.rados.0.smithi175.stdout:155: finishing write tid 4 to smithi17529564-46 2024-04-26T02:24:22.779 INFO:tasks.rados.rados.0.smithi175.stdout:155: finishing write tid 5 to smithi17529564-46 2024-04-26T02:24:22.779 INFO:tasks.rados.rados.0.smithi175.stdout:155: oid 46 updating version 0 to 52 2024-04-26T02:24:22.779 INFO:tasks.rados.rados.0.smithi175.stdout:155: oid 46 updating version 52 to 54 2024-04-26T02:24:22.779 INFO:tasks.rados.rados.0.smithi175.stdout:155: oid 46 version 54 is already newer than 53 2024-04-26T02:24:22.779 INFO:tasks.rados.rados.0.smithi175.stdout:155: oid 46 updating version 54 to 55 2024-04-26T02:24:22.780 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 46 v 55 (ObjNum 88 snap 12 seq_num 88) dirty exists 2024-04-26T02:24:22.780 INFO:tasks.rados.rados.0.smithi175.stdout:155: left oid 46 (ObjNum 88 snap 12 seq_num 88) 2024-04-26T02:24:22.780 INFO:tasks.rados.rados.0.smithi175.stdout:156: finishing write tid 1 to smithi17529564-23 2024-04-26T02:24:22.782 INFO:tasks.rados.rados.0.smithi175.stdout:152: done (7 left) 2024-04-26T02:24:22.782 INFO:tasks.rados.rados.0.smithi175.stdout:153: done (6 left) 2024-04-26T02:24:22.783 INFO:tasks.rados.rados.0.smithi175.stdout:154: done (5 left) 2024-04-26T02:24:22.783 INFO:tasks.rados.rados.0.smithi175.stdout:155: done (4 left) 2024-04-26T02:24:22.783 INFO:tasks.rados.rados.0.smithi175.stdout:160: done (3 left) 2024-04-26T02:24:22.783 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 17 current snap is 12 2024-04-26T02:24:22.783 INFO:tasks.rados.rados.0.smithi175.stdout:161: seq_num 91 ranges {0=770048,770048=475136,1245184=294912} 2024-04-26T02:24:22.787 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:22.789 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:22.789 INFO:tasks.rados.rados.0.smithi175.stdout:161: writing smithi17529564-17 from 0 to 770048 tid 1 2024-04-26T02:24:22.792 INFO:tasks.rados.rados.0.smithi175.stdout:161: writing smithi17529564-17 from 770048 to 1245184 tid 2 2024-04-26T02:24:22.794 INFO:tasks.rados.rados.0.smithi175.stdout:161: writing smithi17529564-17 from 1245184 to 1540096 tid 3 2024-04-26T02:24:22.794 INFO:tasks.rados.rados.0.smithi175.stdout:162: rmattr oid 12 current snap is 12 2024-04-26T02:24:22.795 INFO:tasks.rados.rados.0.smithi175.stdout:162: done (4 left) 2024-04-26T02:24:22.795 INFO:tasks.rados.rados.0.smithi175.stdout:163: delete oid 31 current snap is 12 2024-04-26T02:24:22.795 INFO:tasks.rados.rados.0.smithi175.stdout:156: finishing write tid 2 to smithi17529564-23 2024-04-26T02:24:22.795 INFO:tasks.rados.rados.0.smithi175.stdout:159: expect (ObjNum 1 snap 0 seq_num 1) 2024-04-26T02:24:22.795 INFO:tasks.rados.rados.0.smithi175.stdout:156: finishing write tid 3 to smithi17529564-23 2024-04-26T02:24:22.795 INFO:tasks.rados.rados.0.smithi175.stdout:156: finishing write tid 4 to smithi17529564-23 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:158: finishing rollback tid 0 to smithi17529564-3 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:158: finishing rollback tid 1 to smithi17529564-3 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:158: finishing rollback tid 2 to smithi17529564-3 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 3 v 18 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:156: finishing write tid 5 to smithi17529564-23 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:156: oid 23 updating version 0 to 17 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:156: oid 23 version 17 is already newer than 16 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:156: oid 23 version 17 is already newer than 15 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:156: oid 23 updating version 17 to 18 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 23 v 18 (ObjNum 89 snap 12 seq_num 89) dirty exists 2024-04-26T02:24:22.796 INFO:tasks.rados.rados.0.smithi175.stdout:156: left oid 23 (ObjNum 89 snap 12 seq_num 89) 2024-04-26T02:24:22.798 INFO:tasks.rados.rados.0.smithi175.stdout:161: finishing write tid 1 to smithi17529564-17 2024-04-26T02:24:22.800 INFO:tasks.rados.rados.0.smithi175.stdout:156: done (4 left) 2024-04-26T02:24:22.800 INFO:tasks.rados.rados.0.smithi175.stdout:158: done (3 left) 2024-04-26T02:24:22.800 INFO:tasks.rados.rados.0.smithi175.stdout:159: done (2 left) 2024-04-26T02:24:22.801 INFO:tasks.rados.rados.0.smithi175.stdout:163: done (1 left) 2024-04-26T02:24:22.801 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 10 current snap is 12 2024-04-26T02:24:22.801 INFO:tasks.rados.rados.0.smithi175.stdout:164: seq_num 93 ranges {163840=802816,966656=638976,1605632=131072} 2024-04-26T02:24:22.807 INFO:tasks.rados.rados.0.smithi175.stdout:164: writing smithi17529564-10 from 163840 to 966656 tid 1 2024-04-26T02:24:22.811 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:22.811 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:22.811 INFO:tasks.rados.rados.0.smithi175.stdout:164: writing smithi17529564-10 from 966656 to 1605632 tid 2 2024-04-26T02:24:22.812 INFO:tasks.rados.rados.0.smithi175.stdout:164: writing smithi17529564-10 from 1605632 to 1736704 tid 3 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:165: delete oid 12 current snap is 12 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: finishing write tid 2 to smithi17529564-17 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: finishing write tid 3 to smithi17529564-17 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: finishing write tid 4 to smithi17529564-17 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: finishing write tid 5 to smithi17529564-17 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: oid 17 updating version 0 to 10 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: oid 17 version 10 is already newer than 9 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: oid 17 version 10 is already newer than 8 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: oid 17 updating version 10 to 11 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 17 v 11 (ObjNum 91 snap 12 seq_num 91) dirty exists 2024-04-26T02:24:22.813 INFO:tasks.rados.rados.0.smithi175.stdout:161: left oid 17 (ObjNum 91 snap 12 seq_num 91) 2024-04-26T02:24:22.817 INFO:tasks.rados.rados.0.smithi175.stdout:164: finishing write tid 1 to smithi17529564-10 2024-04-26T02:24:22.819 INFO:tasks.rados.rados.0.smithi175.stdout:161: done (2 left) 2024-04-26T02:24:22.819 INFO:tasks.rados.rados.0.smithi175.stdout:165: done (1 left) 2024-04-26T02:24:22.820 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 15 current snap is 12 2024-04-26T02:24:22.820 INFO:tasks.rados.rados.0.smithi175.stdout:166: seq_num 95 ranges {32768=442368,475136=540672,1015808=622592} 2024-04-26T02:24:22.820 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:22.816+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:22.822 INFO:tasks.rados.rados.0.smithi175.stdout:166: writing smithi17529564-15 from 32768 to 475136 tid 1 2024-04-26T02:24:22.826 INFO:tasks.rados.rados.0.smithi175.stdout:166: writing smithi17529564-15 from 475136 to 1015808 tid 2 2024-04-26T02:24:22.830 INFO:tasks.rados.rados.0.smithi175.stdout:166: writing smithi17529564-15 from 1015808 to 1638400 tid 3 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:167: copy_from oid 25 from oid 46 current snap is 12 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: finishing write tid 2 to smithi17529564-10 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: finishing write tid 3 to smithi17529564-10 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: finishing write tid 4 to smithi17529564-10 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: finishing write tid 5 to smithi17529564-10 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: oid 10 updating version 0 to 16 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: oid 10 version 16 is already newer than 14 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: oid 10 version 16 is already newer than 15 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: oid 10 version 16 is already newer than 13 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 10 v 16 (ObjNum 93 snap 12 seq_num 93) dirty exists 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: left oid 10 (ObjNum 93 snap 12 seq_num 93) 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:164: done (2 left) 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:168: read oid 33 snap -1 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:168: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:24:22.831 INFO:tasks.rados.rados.0.smithi175.stdout:169: snap_create 2024-04-26T02:24:22.834 INFO:tasks.rados.rados.0.smithi175.stdout:166: finishing write tid 1 to smithi17529564-15 2024-04-26T02:24:22.834 INFO:tasks.rados.rados.0.smithi175.stdout:166: finishing write tid 2 to smithi17529564-15 2024-04-26T02:24:22.836 INFO:tasks.rados.rados.0.smithi175.stdout:166: finishing write tid 3 to smithi17529564-15 2024-04-26T02:24:22.837 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:22.837 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:22.838 INFO:tasks.rados.rados.0.smithi175.stdout:166: finishing write tid 4 to smithi17529564-15 2024-04-26T02:24:22.840 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:22.840 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:166: finishing write tid 5 to smithi17529564-15 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:166: oid 15 updating version 0 to 47 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:166: oid 15 version 47 is already newer than 45 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:166: oid 15 version 47 is already newer than 44 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:166: oid 15 version 47 is already newer than 46 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 15 v 47 (ObjNum 95 snap 12 seq_num 95) dirty exists 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:166: left oid 15 (ObjNum 95 snap 12 seq_num 95) 2024-04-26T02:24:22.841 INFO:tasks.rados.rados.0.smithi175.stdout:168: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:24:22.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:24:22.865 INFO:tasks.rados.rados.0.smithi175.stdout:167: finishing copy_from racing read to smithi17529564-25 2024-04-26T02:24:22.869 INFO:tasks.rados.rados.0.smithi175.stdout:167: finishing copy_from to smithi17529564-25 2024-04-26T02:24:22.869 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 25 v 55 (ObjNum 88 snap 12 seq_num 88) dirty exists 2024-04-26T02:24:22.873 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:22.873 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:22.895 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:22.895 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:22.921 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:22.916+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:23.022 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:23.022 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:23.022 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:23.018+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:23.035 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:24:23.119 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:23.155 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:23.155 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:23.158 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:23.152+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:23.159 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:23.159 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:23.174 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:24:23.182 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:23.213 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:23.213 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:23.243 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:23.243 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:23.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:23.240+0000 7f1d97fff640 0 -- 172.21.15.59:0/2760060149 >> [v2:172.21.15.142:6809/4003882581,v1:172.21.15.142:6811/4003882581] conn(0x7f1d98221130 msgr2=0x7f1d98223520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:23.258 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:23.256+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:23.295 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:23.295 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:23.309 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:24:23.359 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:23.352+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:23.432 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:23.433 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:23.447 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:24:23.462 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:23.458+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:23.478 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:23.479 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:23.519 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T02:24:23.535 INFO:tasks.rados.rados.0.smithi175.stdout:166: done (3 left) 2024-04-26T02:24:23.535 INFO:tasks.rados.rados.0.smithi175.stdout:167: done (2 left) 2024-04-26T02:24:23.535 INFO:tasks.rados.rados.0.smithi175.stdout:168: done (1 left) 2024-04-26T02:24:23.535 INFO:tasks.rados.rados.0.smithi175.stdout:169: done (0 left) 2024-04-26T02:24:23.535 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 47 current snap is 13 2024-04-26T02:24:23.535 INFO:tasks.rados.rados.0.smithi175.stdout:170: seq_num 96 ranges {786432=458752,1245184=688128,1933312=475136} 2024-04-26T02:24:23.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T02:24:23.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: writing smithi17529564-47 from 786432 to 1245184 tid 1 2024-04-26T02:24:23.552 INFO:tasks.rados.rados.0.smithi175.stdout:170: writing smithi17529564-47 from 1245184 to 1933312 tid 2 2024-04-26T02:24:23.555 INFO:tasks.rados.rados.0.smithi175.stdout:170: writing smithi17529564-47 from 1933312 to 2408448 tid 3 2024-04-26T02:24:23.555 INFO:tasks.rados.rados.0.smithi175.stdout:171: snap_remove snap 12 2024-04-26T02:24:23.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T02:24:23.560 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:23.558+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:23.572 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:23.572 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:23.586 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:24:23.661 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:23.656+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:23.711 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:23.711 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:23.727 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:24:23.771 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:23.768+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:23.852 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:23.852 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:23.863 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:23.856+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:23.866 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:24:23.964 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:23.962+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:24.037 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:24.037 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:24.052 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:24:24.064 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:24.062+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:24.165 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:24.160+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:24.178 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:24.178 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:24.192 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:24.266 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:24.262+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:24.315 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:24.316 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:24.330 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:24.367 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:24.362+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:24.462 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:24.462 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:24.467 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:24.464+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:24.476 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-04-26T02:24:24.538 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: finishing write tid 1 to smithi17529564-47 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: finishing write tid 2 to smithi17529564-47 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: finishing write tid 3 to smithi17529564-47 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: finishing write tid 4 to smithi17529564-47 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: finishing write tid 5 to smithi17529564-47 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: oid 47 updating version 0 to 42 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: oid 47 version 42 is already newer than 40 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: oid 47 version 42 is already newer than 41 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:170: oid 47 updating version 42 to 43 2024-04-26T02:24:24.545 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 43 (ObjNum 96 snap 13 seq_num 96) dirty exists 2024-04-26T02:24:24.546 INFO:tasks.rados.rados.0.smithi175.stdout:170: left oid 47 (ObjNum 96 snap 13 seq_num 96) 2024-04-26T02:24:24.546 INFO:tasks.rados.rados.0.smithi175.stdout:170: done (1 left) 2024-04-26T02:24:24.546 INFO:tasks.rados.rados.0.smithi175.stdout:171: done (0 left) 2024-04-26T02:24:24.546 INFO:tasks.rados.rados.0.smithi175.stdout:172: rollback oid 4 current snap is 13 2024-04-26T02:24:24.546 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 4 to 11 2024-04-26T02:24:24.546 INFO:tasks.rados.rados.0.smithi175.stdout:173: setattr oid 27 current snap is 13 2024-04-26T02:24:24.549 INFO:tasks.rados.rados.0.smithi175.stdout:174: rmattr oid 29 current snap is 13 2024-04-26T02:24:24.549 INFO:tasks.rados.rados.0.smithi175.stdout:174: done (2 left) 2024-04-26T02:24:24.549 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 22 current snap is 13 2024-04-26T02:24:24.549 INFO:tasks.rados.rados.0.smithi175.stdout:175: seq_num 97 ranges {360448=475136,835584=442368,1277952=442368,1720320=278528} 2024-04-26T02:24:24.557 INFO:tasks.rados.rados.0.smithi175.stdout:175: writing smithi17529564-22 from 360448 to 835584 tid 1 2024-04-26T02:24:24.561 INFO:tasks.rados.rados.0.smithi175.stdout:175: writing smithi17529564-22 from 835584 to 1277952 tid 2 2024-04-26T02:24:24.565 INFO:tasks.rados.rados.0.smithi175.stdout:175: writing smithi17529564-22 from 1277952 to 1720320 tid 3 2024-04-26T02:24:24.568 INFO:tasks.rados.rados.0.smithi175.stdout:175: writing smithi17529564-22 from 1720320 to 1998848 tid 4 2024-04-26T02:24:24.568 INFO:tasks.rados.rados.0.smithi175.stdout:176: setattr oid 10 current snap is 13 2024-04-26T02:24:24.568 INFO:tasks.rados.rados.0.smithi175.stdout:172: finishing rollback tid 0 to smithi17529564-4 2024-04-26T02:24:24.568 INFO:tasks.rados.rados.0.smithi175.stdout:172: finishing rollback tid 1 to smithi17529564-4 2024-04-26T02:24:24.568 INFO:tasks.rados.rados.0.smithi175.stdout:172: finishing rollback tid 2 to smithi17529564-4 2024-04-26T02:24:24.569 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 40 (ObjNum 81 snap 7 seq_num 81) dirty exists 2024-04-26T02:24:24.569 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 27 v 26 (ObjNum 129 snap 0 seq_num 3111859224) dirty exists 2024-04-26T02:24:24.569 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:24.564+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:24.570 INFO:tasks.rados.rados.0.smithi175.stdout:172: done (3 left) 2024-04-26T02:24:24.570 INFO:tasks.rados.rados.0.smithi175.stdout:173: done (2 left) 2024-04-26T02:24:24.570 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 34 current snap is 13 2024-04-26T02:24:24.570 INFO:tasks.rados.rados.0.smithi175.stdout:177: seq_num 98 ranges {557056=491520,1048576=589824,1638400=557056,2195456=16384} 2024-04-26T02:24:24.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T02:24:24.580 INFO:tasks.rados.rados.0.smithi175.stdout:177: writing smithi17529564-34 from 557056 to 1048576 tid 1 2024-04-26T02:24:24.587 INFO:tasks.rados.rados.0.smithi175.stdout:177: writing smithi17529564-34 from 1048576 to 1638400 tid 2 2024-04-26T02:24:24.594 INFO:tasks.rados.rados.0.smithi175.stdout:177: writing smithi17529564-34 from 1638400 to 2195456 tid 3 2024-04-26T02:24:24.594 INFO:tasks.rados.rados.0.smithi175.stdout:177: writing smithi17529564-34 from 2195456 to 2211840 tid 4 2024-04-26T02:24:24.594 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 32 current snap is 13 2024-04-26T02:24:24.594 INFO:tasks.rados.rados.0.smithi175.stdout:178: seq_num 99 ranges {524288=507904,1032192=606208,1638400=557056} 2024-04-26T02:24:24.604 INFO:tasks.rados.rados.0.smithi175.stdout:178: writing smithi17529564-32 from 524288 to 1032192 tid 1 2024-04-26T02:24:24.608 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:24.608 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:24.609 INFO:tasks.rados.rados.0.smithi175.stdout:178: writing smithi17529564-32 from 1032192 to 1638400 tid 2 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:178: writing smithi17529564-32 from 1638400 to 2195456 tid 3 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:179: delete oid 44 current snap is 13 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:175: finishing write tid 1 to smithi17529564-22 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:175: finishing write tid 2 to smithi17529564-22 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:175: finishing write tid 3 to smithi17529564-22 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 10 v 17 (ObjNum 93 snap 12 seq_num 93) dirty exists 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:175: finishing write tid 4 to smithi17529564-22 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:175: finishing write tid 5 to smithi17529564-22 2024-04-26T02:24:24.614 INFO:tasks.rados.rados.0.smithi175.stdout:177: finishing write tid 1 to smithi17529564-34 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:177: finishing write tid 2 to smithi17529564-34 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:175: finishing write tid 6 to smithi17529564-22 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:175: oid 22 updating version 0 to 7 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:175: oid 22 updating version 7 to 9 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:175: oid 22 updating version 9 to 10 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:175: oid 22 version 10 is already newer than 6 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:175: oid 22 version 10 is already newer than 8 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 22 v 10 (ObjNum 97 snap 13 seq_num 97) dirty exists 2024-04-26T02:24:24.615 INFO:tasks.rados.rados.0.smithi175.stdout:175: left oid 22 (ObjNum 97 snap 13 seq_num 97) 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: finishing write tid 3 to smithi17529564-34 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: finishing write tid 4 to smithi17529564-34 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: finishing write tid 5 to smithi17529564-34 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: finishing write tid 6 to smithi17529564-34 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: oid 34 updating version 0 to 58 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: oid 34 updating version 58 to 60 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: oid 34 updating version 60 to 61 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: oid 34 version 61 is already newer than 57 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: oid 34 version 61 is already newer than 59 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 34 v 61 (ObjNum 98 snap 13 seq_num 98) dirty exists 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:177: left oid 34 (ObjNum 98 snap 13 seq_num 98) 2024-04-26T02:24:24.616 INFO:tasks.rados.rados.0.smithi175.stdout:178: finishing write tid 1 to smithi17529564-32 2024-04-26T02:24:24.617 INFO:tasks.rados.rados.0.smithi175.stdout:178: finishing write tid 2 to smithi17529564-32 2024-04-26T02:24:24.618 INFO:tasks.rados.rados.0.smithi175.stdout:175: done (4 left) 2024-04-26T02:24:24.618 INFO:tasks.rados.rados.0.smithi175.stdout:176: done (3 left) 2024-04-26T02:24:24.618 INFO:tasks.rados.rados.0.smithi175.stdout:177: done (2 left) 2024-04-26T02:24:24.618 INFO:tasks.rados.rados.0.smithi175.stdout:179: done (1 left) 2024-04-26T02:24:24.618 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 44 current snap is 13 2024-04-26T02:24:24.618 INFO:tasks.rados.rados.0.smithi175.stdout:180: seq_num 101 ranges {0=540672,540672=507904,1048576=622592,1671168=32768} 2024-04-26T02:24:24.622 INFO:tasks.rados.rados.0.smithi175.stdout:180: writing smithi17529564-44 from 0 to 540672 tid 1 2024-04-26T02:24:24.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:24.626 INFO:tasks.rados.rados.0.smithi175.stdout:180: writing smithi17529564-44 from 540672 to 1048576 tid 2 2024-04-26T02:24:24.630 INFO:tasks.rados.rados.0.smithi175.stdout:180: writing smithi17529564-44 from 1048576 to 1671168 tid 3 2024-04-26T02:24:24.631 INFO:tasks.rados.rados.0.smithi175.stdout:180: writing smithi17529564-44 from 1671168 to 1703936 tid 4 2024-04-26T02:24:24.631 INFO:tasks.rados.rados.0.smithi175.stdout:181: read oid 30 snap 4 2024-04-26T02:24:24.631 INFO:tasks.rados.rados.0.smithi175.stdout:181: expect (ObjNum 62 snap 3 seq_num 62) 2024-04-26T02:24:24.631 INFO:tasks.rados.rados.0.smithi175.stdout:182: read oid 21 snap 11 2024-04-26T02:24:24.631 INFO:tasks.rados.rados.0.smithi175.stdout:182: expect (ObjNum 72 snap 4 seq_num 72) 2024-04-26T02:24:24.631 INFO:tasks.rados.rados.0.smithi175.stdout:183: copy_from oid 14 from oid 28 current snap is 13 2024-04-26T02:24:24.631 INFO:tasks.rados.rados.0.smithi175.stdout:178: finishing write tid 3 to smithi17529564-32 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: finishing write tid 4 to smithi17529564-32 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: finishing write tid 5 to smithi17529564-32 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: oid 32 updating version 0 to 34 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: oid 32 version 34 is already newer than 33 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: oid 32 updating version 34 to 35 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: oid 32 updating version 35 to 36 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 32 v 36 (ObjNum 99 snap 13 seq_num 99) dirty exists 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: left oid 32 (ObjNum 99 snap 13 seq_num 99) 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:180: finishing write tid 1 to smithi17529564-44 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:178: done (4 left) 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 6 current snap is 13 2024-04-26T02:24:24.632 INFO:tasks.rados.rados.0.smithi175.stdout:184: seq_num 102 ranges {2637824=557056,3194880=638976,3833856=524288} 2024-04-26T02:24:24.654 INFO:tasks.rados.rados.0.smithi175.stdout:184: writing smithi17529564-6 from 2637824 to 3194880 tid 1 2024-04-26T02:24:24.659 INFO:tasks.rados.rados.0.smithi175.stdout:184: writing smithi17529564-6 from 3194880 to 3833856 tid 2 2024-04-26T02:24:24.663 INFO:tasks.rados.rados.0.smithi175.stdout:184: writing smithi17529564-6 from 3833856 to 4358144 tid 3 2024-04-26T02:24:24.663 INFO:tasks.rados.rados.0.smithi175.stdout:185: rollback oid 2 current snap is 13 2024-04-26T02:24:24.663 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 2 to 11 2024-04-26T02:24:24.663 INFO:tasks.rados.rados.0.smithi175.stdout:186: rmattr oid 47 current snap is 13 2024-04-26T02:24:24.663 INFO:tasks.rados.rados.0.smithi175.stdout:187: read oid 35 snap -1 2024-04-26T02:24:24.664 INFO:tasks.rados.rados.0.smithi175.stdout:187: expect deleted 2024-04-26T02:24:24.664 INFO:tasks.rados.rados.0.smithi175.stdout:188: snap_remove snap 10 2024-04-26T02:24:24.669 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:24.664+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:24.753 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:24.753 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:24.767 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:24.771 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:24.766+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:24.872 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:24.870+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:24.888 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:24.888 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:24.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:24.972 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:24.970+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:25.020 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:25.020 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:25.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:25.073 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:25.070+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:25.157 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:25.158 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:25.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:25.173 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:25.170+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:25.274 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:25.270+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:25.288 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:25.288 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:25.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:25.375 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:25.372+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:25.419 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:25.419 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:25.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:25.476 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:25.474+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:25.541 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T02:24:25.547 INFO:tasks.rados.rados.0.smithi175.stdout:188: done (8 left) 2024-04-26T02:24:25.547 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 32 current snap is 13 2024-04-26T02:24:25.547 INFO:tasks.rados.rados.0.smithi175.stdout:180: finishing write tid 2 to smithi17529564-44 2024-04-26T02:24:25.547 INFO:tasks.rados.rados.0.smithi175.stdout:180: finishing write tid 3 to smithi17529564-44 2024-04-26T02:24:25.547 INFO:tasks.rados.rados.0.smithi175.stdout:189: seq_num 103 ranges {2195456=573440,2768896=786432,3555328=376832} 2024-04-26T02:24:25.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:25.571 INFO:tasks.rados.rados.0.smithi175.stdout:189: writing smithi17529564-32 from 2195456 to 2768896 tid 1 2024-04-26T02:24:25.577 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:25.572+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:25.578 INFO:tasks.rados.rados.0.smithi175.stdout:189: writing smithi17529564-32 from 2768896 to 3555328 tid 2 2024-04-26T02:24:25.583 INFO:tasks.rados.rados.0.smithi175.stdout:189: writing smithi17529564-32 from 3555328 to 3932160 tid 3 2024-04-26T02:24:25.583 INFO:tasks.rados.rados.0.smithi175.stdout:180: finishing write tid 4 to smithi17529564-44 2024-04-26T02:24:25.583 INFO:tasks.rados.rados.0.smithi175.stdout:180: finishing write tid 5 to smithi17529564-44 2024-04-26T02:24:25.583 INFO:tasks.rados.rados.0.smithi175.stdout:182: expect (ObjNum 72 snap 4 seq_num 72) 2024-04-26T02:24:25.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T02:24:25.611 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:25.611 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:25.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:25.626 INFO:tasks.rados.rados.0.smithi175.stdout:180: finishing write tid 6 to smithi17529564-44 2024-04-26T02:24:25.626 INFO:tasks.rados.rados.0.smithi175.stdout:180: oid 44 updating version 0 to 35 2024-04-26T02:24:25.626 INFO:tasks.rados.rados.0.smithi175.stdout:180: oid 44 updating version 35 to 37 2024-04-26T02:24:25.626 INFO:tasks.rados.rados.0.smithi175.stdout:180: oid 44 version 37 is already newer than 36 2024-04-26T02:24:25.626 INFO:tasks.rados.rados.0.smithi175.stdout:180: oid 44 version 37 is already newer than 33 2024-04-26T02:24:25.627 INFO:tasks.rados.rados.0.smithi175.stdout:180: oid 44 version 37 is already newer than 34 2024-04-26T02:24:25.627 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 44 v 37 (ObjNum 101 snap 13 seq_num 101) dirty exists 2024-04-26T02:24:25.627 INFO:tasks.rados.rados.0.smithi175.stdout:180: left oid 44 (ObjNum 101 snap 13 seq_num 101) 2024-04-26T02:24:25.627 INFO:tasks.rados.rados.0.smithi175.stdout:181: expect (ObjNum 62 snap 3 seq_num 62) 2024-04-26T02:24:25.659 INFO:tasks.rados.rados.0.smithi175.stdout:183: finishing copy_from racing read to smithi17529564-14 2024-04-26T02:24:25.659 INFO:tasks.rados.rados.0.smithi175.stdout:183: finishing copy_from to smithi17529564-14 2024-04-26T02:24:25.659 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 14 v 24 (ObjNum 82 snap 8 seq_num 82) dirty exists 2024-04-26T02:24:25.659 INFO:tasks.rados.rados.0.smithi175.stdout:184: finishing write tid 1 to smithi17529564-6 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:184: finishing write tid 2 to smithi17529564-6 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:180: done (8 left) 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:181: done (7 left) 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:182: done (6 left) 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:183: done (5 left) 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:187: done (4 left) 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:190: rollback oid 18 current snap is 13 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 18 to 4 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:185: finishing rollback tid 0 to smithi17529564-2 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 46 (ObjNum 96 snap 13 seq_num 96) dirty exists 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:185: finishing rollback tid 1 to smithi17529564-2 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:185: finishing rollback tid 2 to smithi17529564-2 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 2 v 25 (ObjNum 1 snap 0 seq_num 1) dirty exists 2024-04-26T02:24:25.660 INFO:tasks.rados.rados.0.smithi175.stdout:184: finishing write tid 3 to smithi17529564-6 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:184: finishing write tid 4 to smithi17529564-6 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:184: finishing write tid 5 to smithi17529564-6 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:184: oid 6 updating version 0 to 58 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:184: oid 6 version 58 is already newer than 57 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:184: oid 6 updating version 58 to 59 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:184: oid 6 version 59 is already newer than 56 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 6 v 59 (ObjNum 102 snap 13 seq_num 102) dirty exists 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:184: left oid 6 (ObjNum 102 snap 13 seq_num 102) 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:189: finishing write tid 1 to smithi17529564-32 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:189: finishing write tid 2 to smithi17529564-32 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:189: finishing write tid 3 to smithi17529564-32 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:189: finishing write tid 4 to smithi17529564-32 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:189: finishing write tid 5 to smithi17529564-32 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:189: oid 32 updating version 0 to 41 2024-04-26T02:24:25.661 INFO:tasks.rados.rados.0.smithi175.stdout:189: oid 32 version 41 is already newer than 40 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:189: oid 32 updating version 41 to 43 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:189: oid 32 version 43 is already newer than 42 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 32 v 43 (ObjNum 103 snap 13 seq_num 103) dirty exists 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:189: left oid 32 (ObjNum 103 snap 13 seq_num 103) 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:184: done (4 left) 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:185: done (3 left) 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:186: done (2 left) 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:189: done (1 left) 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 30 current snap is 13 2024-04-26T02:24:25.662 INFO:tasks.rados.rados.0.smithi175.stdout:191: seq_num 104 ranges {2490368=589824,3080192=540672,3620864=622592} 2024-04-26T02:24:25.677 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:25.674+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:25.688 INFO:tasks.rados.rados.0.smithi175.stdout:191: writing smithi17529564-30 from 2490368 to 3080192 tid 1 2024-04-26T02:24:25.695 INFO:tasks.rados.rados.0.smithi175.stdout:191: writing smithi17529564-30 from 3080192 to 3620864 tid 2 2024-04-26T02:24:25.702 INFO:tasks.rados.rados.0.smithi175.stdout:191: writing smithi17529564-30 from 3620864 to 4243456 tid 3 2024-04-26T02:24:25.702 INFO:tasks.rados.rados.0.smithi175.stdout:192: read oid 21 snap 11 2024-04-26T02:24:25.702 INFO:tasks.rados.rados.0.smithi175.stdout:192: expect (ObjNum 72 snap 4 seq_num 72) 2024-04-26T02:24:25.702 INFO:tasks.rados.rados.0.smithi175.stdout:193: copy_from oid 20 from oid 27 current snap is 13 2024-04-26T02:24:25.702 INFO:tasks.rados.rados.0.smithi175.stdout:190: finishing rollback tid 0 to smithi17529564-18 2024-04-26T02:24:25.702 INFO:tasks.rados.rados.0.smithi175.stdout:190: finishing rollback tid 1 to smithi17529564-18 2024-04-26T02:24:25.703 INFO:tasks.rados.rados.0.smithi175.stdout:190: finishing rollback tid 2 to smithi17529564-18 2024-04-26T02:24:25.703 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 18 v 71 (ObjNum 17 snap 0 seq_num 17) dirty exists 2024-04-26T02:24:25.703 INFO:tasks.rados.rados.0.smithi175.stdout:191: finishing write tid 1 to smithi17529564-30 2024-04-26T02:24:25.703 INFO:tasks.rados.rados.0.smithi175.stdout:191: finishing write tid 2 to smithi17529564-30 2024-04-26T02:24:25.703 INFO:tasks.rados.rados.0.smithi175.stdout:190: done (3 left) 2024-04-26T02:24:25.703 INFO:tasks.rados.rados.0.smithi175.stdout:194: snap_remove snap 4 2024-04-26T02:24:25.717 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:25.718 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:25.738 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:25.739 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:25.758 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:25.758 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:25.778 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:25.772+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:25.781 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:25.781 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:25.794 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:25.795 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:25.797 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:25.798 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:25.809 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:25.819 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:25.820 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:25.839 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:25.859 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:25.860 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:25.876 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:25.876 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:25.879 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:25.878+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:25.899 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:25.899 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:25.920 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:25.921 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:25.932 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:25.932 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:25.942 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:25.942 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:25.946 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:25.960 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:25.960 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:25.979 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:25.980+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:25.982 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:25.982 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:26.001 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:26.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:25.996+0000 7f02f533b640 0 -- 172.21.15.59:0/3706147643 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f02f0222020 msgr2=0x7f02f0224410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.039734+0000", 2024-04-26T02:24:26.070 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.027169941, 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005354429, 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039734+0000", 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039734+0000", 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039735+0000", 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039794+0000", 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9098000000000002e-05 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039826+0000", 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2738999999999999e-05 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039852+0000", 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5329000000000001e-05 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040039+0000", 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000187634 2024-04-26T02:24:26.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040065+0000", 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5933000000000001e-05 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.044985+0000", 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004919975 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045088+0000", 2024-04-26T02:24:26.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010296100000000001 2024-04-26T02:24:26.075 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 37/31 ECSubWrite(tid=13, reqid=osd.15.0:13, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.047810+0000", 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.019093917999999, 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060574679999999999, 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.076 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047810+0000", 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047810+0000", 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047811+0000", 2024-04-26T02:24:26.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3600000000000003e-07 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047871+0000", 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0735e-05 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048185+0000", 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031401900000000002 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048214+0000", 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8209e-05 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048905+0000", 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069098800000000002 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048927+0000", 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053781+0000", 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048537010000000002 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.053867+0000", 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6397000000000006e-05 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 38/31 ECSubWrite(tid=15, reqid=osd.15.0:15, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.034547+0000", 2024-04-26T02:24:26.080 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.032356392000001, 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004671489, 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034547+0000", 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034547+0000", 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034548+0000", 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4600000000000004e-07 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034598+0000", 2024-04-26T02:24:26.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0145000000000002e-05 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034631+0000", 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3049000000000002e-05 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034654+0000", 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2996000000000001e-05 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034835+0000", 2024-04-26T02:24:26.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018020800000000001 2024-04-26T02:24:26.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.034851+0000", 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6793e-05 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.039119+0000", 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042677519999999997 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.039219+0000", 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.98e-05 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041065+0000", 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.025838632999999, 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0052047999999999999, 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041065+0000", 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041065+0000", 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041066+0000", 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7000000000000004e-07 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041160+0000", 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3770999999999994e-05 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041195+0000", 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5132000000000002e-05 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041219+0000", 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4389e-05 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041818+0000", 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00059878500000000001 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041847+0000", 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8555999999999999e-05 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046147+0000", 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043004180000000003 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046270+0000", 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122979 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.025024788, 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085372480000000008, 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.091 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041880+0000", 2024-04-26T02:24:26.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1999999999999998e-07 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041925+0000", 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4909e-05 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041954+0000", 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8889000000000001e-05 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042023+0000", 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9521000000000001e-05 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042984+0000", 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096037100000000001 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.043008+0000", 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4519e-05 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050324+0000", 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073160580000000003 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050416+0000", 2024-04-26T02:24:26.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2060999999999998e-05 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.044860+0000", 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.022043363000002, 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056374570000000002, 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.096 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044860+0000", 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044860+0000", 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044862+0000", 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6470000000000001e-06 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044888+0000", 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5822000000000001e-05 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044917+0000", 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8653000000000002e-05 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.044939+0000", 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2255999999999998e-05 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.045089+0000", 2024-04-26T02:24:26.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000150715 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.045113+0000", 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3699000000000001e-05 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050428+0000", 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053147940000000003 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050498+0000", 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9870999999999996e-05 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.056624+0000", 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.010279474000001, 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048797700000000003, 2024-04-26T02:24:26.101 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056624+0000", 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056624+0000", 2024-04-26T02:24:26.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056625+0000", 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.023e-06 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056650+0000", 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4280000000000001e-05 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056677+0000", 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6982e-05 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056696+0000", 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9315999999999999e-05 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056914+0000", 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000218097 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.056935+0000", 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0548999999999999e-05 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061419+0000", 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044849219999999997 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.061504+0000", 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4600999999999999e-05 2024-04-26T02:24:26.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s5 39/31 ECSubWrite(tid=16, reqid=client.4589.0:211, at_version=39'9, trim_to=0'0, roll_forward_to=34'7))", 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.976563229, 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061710209999999996, 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090341+0000", 2024-04-26T02:24:26.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4399999999999999e-07 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090828+0000", 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000487061 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090865+0000", 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6256e-05 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.090890+0000", 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5802000000000001e-05 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.091065+0000", 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000174945 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.091095+0000", 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9105999999999999e-05 2024-04-26T02:24:26.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.096411+0000", 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053165299999999999 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:07.096512+0000", 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010047699999999999 2024-04-26T02:24:26.110 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 48/31 ECSubWrite(tid=91, reqid=client.4589.0:324, at_version=48'22, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.487837+0000", 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.579066256000001, 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097515859999999996, 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487837+0000", 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487837+0000", 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487838+0000", 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0999999999999998e-07 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487893+0000", 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5262e-05 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487924+0000", 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0614999999999997e-05 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487952+0000", 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7872999999999999e-05 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.488114+0000", 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016165600000000001 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.488144+0000", 2024-04-26T02:24:26.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0676000000000002e-05 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497496+0000", 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093519529999999997 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497589+0000", 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2841000000000001e-05 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 48/31 ECSubWrite(tid=92, reqid=client.4589.0:325, at_version=48'23, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.489922+0000", 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.576981503000001, 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007745811, 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489922+0000", 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489922+0000", 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489924+0000", 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8899999999999999e-06 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489971+0000", 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7018999999999998e-05 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490017+0000", 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5905000000000002e-05 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490040+0000", 2024-04-26T02:24:26.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2932999999999999e-05 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490307+0000", 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026734300000000002 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490335+0000", 2024-04-26T02:24:26.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7356e-05 2024-04-26T02:24:26.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497606+0000", 2024-04-26T02:24:26.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072711829999999996 2024-04-26T02:24:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497668+0000", 2024-04-26T02:24:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2181999999999995e-05 2024-04-26T02:24:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 48/31 ECSubWrite(tid=93, reqid=client.4589.0:326, at_version=48'24, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.491885+0000", 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.57501858, 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058363360000000001, 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491885+0000", 2024-04-26T02:24:26.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491885+0000", 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491887+0000", 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.683e-06 2024-04-26T02:24:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491929+0000", 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1732e-05 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491960+0000", 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1006000000000001e-05 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491983+0000", 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3405999999999999e-05 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.492282+0000", 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00029943199999999998 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.492313+0000", 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0593000000000003e-05 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497673+0000", 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005359562 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497722+0000", 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8921999999999997e-05 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.128 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 48/31 ECSubWrite(tid=14, reqid=osd.3.0:14, at_version=48'12, trim_to=0'0, roll_forward_to=47'10))", 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.571717195, 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079870340000000005, 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495244+0000", 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6628000000000001e-05 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495273+0000", 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9213e-05 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495297+0000", 2024-04-26T02:24:26.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4066e-05 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496180+0000", 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088288699999999995 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496209+0000", 2024-04-26T02:24:26.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503084+0000", 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068750599999999997 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503174+0000", 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9926999999999995e-05 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.133 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 48/31 ECSubWrite(tid=95, reqid=osd.0.0:94, at_version=0'0, trim_to=0'0, roll_forward_to=48'26))", 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.500408+0000", 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.566495543, 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006048655, 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500408+0000", 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500408+0000", 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500410+0000", 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.057e-06 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500438+0000", 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7855999999999999e-05 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500469+0000", 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1256e-05 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500491+0000", 2024-04-26T02:24:26.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2096e-05 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500659+0000", 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000167109 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500689+0000", 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0205999999999998e-05 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.506346+0000", 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056576040000000001 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.506457+0000", 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011047100000000001 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 48/31 ECSubWrite(tid=38, reqid=osd.15.0:38, at_version=48'28, trim_to=0'0, roll_forward_to=47'26))", 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.507352+0000", 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.559551328, 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053073369999999996, 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507352+0000", 2024-04-26T02:24:26.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507352+0000", 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507353+0000", 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507409+0000", 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6394999999999998e-05 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507439+0000", 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9448999999999999e-05 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507461+0000", 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2087e-05 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507662+0000", 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000200998 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.507688+0000", 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5836000000000001e-05 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.512557+0000", 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0048692980000000002 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.512660+0000", 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102614 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 55/31 ECSubWrite(tid=63, reqid=client.4589.0:395, at_version=55'17, trim_to=0'0, roll_forward_to=55'15))", 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.779185+0000", 2024-04-26T02:24:26.143 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.287718516, 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059302349999999998, 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779185+0000", 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779185+0000", 2024-04-26T02:24:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779187+0000", 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.813e-06 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779276+0000", 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8714999999999993e-05 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779320+0000", 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4141999999999999e-05 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779342+0000", 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1653000000000001e-05 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779485+0000", 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000143277 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779510+0000", 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5609000000000002e-05 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.784880+0000", 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0053699009999999998 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.785115+0000", 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023512500000000001 2024-04-26T02:24:26.147 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 55/31 ECSubWrite(tid=64, reqid=client.4589.0:396, at_version=55'18, trim_to=0'0, roll_forward_to=55'15))", 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.779394+0000", 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.287509467, 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058405560000000002, 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779394+0000", 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779394+0000", 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779395+0000", 2024-04-26T02:24:26.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1030000000000001e-06 2024-04-26T02:24:26.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779451+0000", 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5642e-05 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779476+0000", 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4909000000000002e-05 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779496+0000", 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9830000000000002e-05 2024-04-26T02:24:26.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.780622+0000", 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0011264090000000001 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.780638+0000", 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6175999999999999e-05 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.785166+0000", 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0045278660000000002 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.785235+0000", 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8621000000000006e-05 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 55/31 ECSubWrite(tid=18, reqid=client.4589.0:398, at_version=55'16, trim_to=0'0, roll_forward_to=51'14))", 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.779597+0000", 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.2873071019999998, 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054559350000000003, 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779597+0000", 2024-04-26T02:24:26.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779597+0000", 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779598+0000", 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8299999999999995e-07 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779645+0000", 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7432999999999998e-05 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779670+0000", 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4822999999999999e-05 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779690+0000", 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0061999999999999e-05 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779864+0000", 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017389700000000001 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.779890+0000", 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6585999999999999e-05 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.784963+0000", 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00507304 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.785053+0000", 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9210999999999997e-05 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 55/31 ECSubWrite(tid=19, reqid=client.4589.0:399, at_version=55'17, trim_to=0'0, roll_forward_to=51'14))", 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.781364+0000", 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.28553929, 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0046491960000000004, 2024-04-26T02:24:26.158 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781364+0000", 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781364+0000", 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781366+0000", 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.823e-06 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781412+0000", 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6159000000000003e-05 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781444+0000", 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1931999999999999e-05 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781466+0000", 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1477000000000001e-05 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781627+0000", 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016123600000000001 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.161 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.781653+0000", 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.62e-05 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.785925+0000", 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0042720739999999998 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.786014+0000", 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8294999999999994e-05 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs6 55/31 ECSubWrite(tid=24, reqid=client.4589.0:414, at_version=55'16, trim_to=0'0, roll_forward_to=55'13))", 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.820461+0000", 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.2464431930000002, 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049731519999999998, 2024-04-26T02:24:26.163 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820461+0000", 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820461+0000", 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820462+0000", 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.674e-06 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820503+0000", 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1054999999999999e-05 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820532+0000", 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8955999999999999e-05 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820555+0000", 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2357e-05 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820677+0000", 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012271299999999999 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.820699+0000", 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.213e-05 2024-04-26T02:24:26.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.825366+0000", 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.004666122 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.825434+0000", 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8145000000000006e-05 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.167 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s2 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.860021+0000", 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.2068826750000001, 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097130189999999998, 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:26.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.860021+0000", 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.860021+0000", 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.860022+0000", 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6000000000000004e-07 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:26.169 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863762+0000", 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037407019999999998 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863788+0000", 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5873000000000001e-05 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863806+0000", 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.806e-05 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863984+0000", 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017777900000000001 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.864014+0000", 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9779000000000001e-05 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.869664+0000", 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056499640000000004 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:26.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.869734+0000", 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0302000000000006e-05 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:26.172 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:26.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:26.174 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:26.172+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:26.226 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:26.226 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:26.275 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:26.272+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:26.305 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:26.305 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:26.305 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:26.305 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:26.321 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:26.375 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:26.372+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:26.444 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:26.444 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:26.444 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:26.444 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:26.444 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:26.458 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:26.476 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:26.472+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:26.552 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T02:24:26.561 INFO:tasks.rados.rados.0.smithi175.stdout:194: done (3 left) 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:195: read oid 9 snap 11 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:195: expect (ObjNum 8 snap 0 seq_num 8) 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:196: snap_create 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:191: finishing write tid 3 to smithi17529564-30 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:193: finishing copy_from racing read to smithi17529564-20 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:191: finishing write tid 4 to smithi17529564-30 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:191: finishing write tid 5 to smithi17529564-30 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:191: oid 30 updating version 0 to 46 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:191: oid 30 updating version 46 to 47 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:191: oid 30 updating version 47 to 48 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:191: oid 30 version 48 is already newer than 45 2024-04-26T02:24:26.562 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 48 (ObjNum 104 snap 13 seq_num 104) dirty exists 2024-04-26T02:24:26.563 INFO:tasks.rados.rados.0.smithi175.stdout:191: left oid 30 (ObjNum 104 snap 13 seq_num 104) 2024-04-26T02:24:26.563 INFO:tasks.rados.rados.0.smithi175.stdout:193: finishing copy_from to smithi17529564-20 2024-04-26T02:24:26.563 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 20 v 26 (ObjNum 129 snap 0 seq_num 3111404584) dirty exists 2024-04-26T02:24:26.563 INFO:tasks.rados.rados.0.smithi175.stdout:192: expect (ObjNum 72 snap 4 seq_num 72) 2024-04-26T02:24:26.574 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:24:26.578 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:26.572+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:26.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-04-26T02:24:26.610 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:26.610 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.571623465000002, 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011126728000000001, 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034940+0000", 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.663e-06 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034988+0000", 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7794999999999999e-05 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035017+0000", 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9139e-05 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035039+0000", 2024-04-26T02:24:26.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2178999999999999e-05 2024-04-26T02:24:26.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035616+0000", 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057682000000000002 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035639+0000", 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2915999999999999e-05 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045974+0000", 2024-04-26T02:24:26.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01033568 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046065+0000", 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0536000000000002e-05 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.042769+0000", 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.563792783, 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0075953629999999999, 2024-04-26T02:24:26.616 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042769+0000", 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042769+0000", 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042770+0000", 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042823+0000", 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2791000000000003e-05 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042847+0000", 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4249000000000001e-05 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042864+0000", 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7413000000000001e-05 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043864+0000", 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0009993370000000001 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043887+0000", 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3422e-05 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050274+0000", 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063871860000000004 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050364+0000", 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0007999999999996e-05 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.620 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 37/31 ECSubWrite(tid=63, reqid=osd.0.0:63, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.043801+0000", 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.562760524000002, 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066390779999999996, 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043801+0000", 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043801+0000", 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043803+0000", 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7570000000000001e-06 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043850+0000", 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7240999999999997e-05 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043880+0000", 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0312e-05 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043902+0000", 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2039e-05 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044115+0000", 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021216599999999999 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044139+0000", 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4042000000000001e-05 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050389+0000", 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062503810000000002 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050440+0000", 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1140000000000002e-05 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.624 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=27, reqid=osd.8.0:26, at_version=0'0, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.047465+0000", 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.559097008999998, 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054258980000000002, 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047465+0000", 2024-04-26T02:24:26.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047465+0000", 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047467+0000", 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0669999999999999e-06 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047493+0000", 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6749000000000001e-05 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047555+0000", 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1489999999999996e-05 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047579+0000", 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4148999999999999e-05 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047775+0000", 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019593599999999999 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047789+0000", 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3879e-05 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052798+0000", 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050089109999999996 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052891+0000", 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2717e-05 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.047959+0000", 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.558602859000001, 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050013519999999997, 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047959+0000", 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047959+0000", 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047960+0000", 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.59e-06 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048009+0000", 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8897999999999998e-05 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048039+0000", 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9882e-05 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048059+0000", 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9908999999999999e-05 2024-04-26T02:24:26.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048272+0000", 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000213076 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048294+0000", 2024-04-26T02:24:26.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1882000000000002e-05 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052896+0000", 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046023740000000002 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052960+0000", 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3740999999999998e-05 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.633 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 37/31 ECSubWrite(tid=65, reqid=osd.0.0:62, at_version=0'0, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.056216+0000", 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.550345827000001, 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049998380000000004, 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056216+0000", 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056216+0000", 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056218+0000", 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7630000000000001e-06 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056261+0000", 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3105999999999997e-05 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056291+0000", 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0437999999999999e-05 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056315+0000", 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3543000000000001e-05 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056624+0000", 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030905400000000001 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056649+0000", 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4776000000000001e-05 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061142+0000", 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044931959999999996 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061216+0000", 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3961999999999994e-05 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=29, reqid=osd.8.0:28, at_version=0'0, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.056393+0000", 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.550168840000001, 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049395730000000001, 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.638 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056393+0000", 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056393+0000", 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056394+0000", 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2929999999999999e-06 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056419+0000", 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4909000000000002e-05 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056445+0000", 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6122000000000002e-05 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.056466+0000", 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1212999999999998e-05 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.057127+0000", 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00066085000000000004 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.057148+0000", 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1186e-05 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061248+0000", 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040996469999999997 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.061332+0000", 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4352999999999997e-05 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=30, reqid=client.4589.0:197, at_version=37'23, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:26.642 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.062322+0000", 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.54423938, 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0074342230000000002, 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062322+0000", 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062322+0000", 2024-04-26T02:24:26.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062436+0000", 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011413699999999999 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062708+0000", 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027112700000000002 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062746+0000", 2024-04-26T02:24:26.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8702999999999999e-05 2024-04-26T02:24:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062764+0000", 2024-04-26T02:24:26.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8029999999999998e-05 2024-04-26T02:24:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062913+0000", 2024-04-26T02:24:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000148274 2024-04-26T02:24:26.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.062942+0000", 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9218999999999999e-05 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.069685+0000", 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067435689999999996 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.069757+0000", 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1163999999999998e-05 2024-04-26T02:24:26.647 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.040122+0000", 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.566439499000001, 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051440319999999998, 2024-04-26T02:24:26.648 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040122+0000", 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040122+0000", 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040124+0000", 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.66e-06 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040165+0000", 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0669e-05 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040189+0000", 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4482e-05 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040204+0000", 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4532000000000001e-05 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040422+0000", 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021852899999999999 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.040447+0000", 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5299e-05 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.045189+0000", 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047420880000000002 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.045266+0000", 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6773000000000005e-05 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.653 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 38/31 ECSubWrite(tid=49, reqid=osd.12.0:49, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.041802+0000", 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.564759218999999, 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047115029999999997, 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041802+0000", 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041802+0000", 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041803+0000", 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3399999999999999e-07 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041853+0000", 2024-04-26T02:24:26.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9681000000000001e-05 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041880+0000", 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6801999999999999e-05 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.041902+0000", 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1996000000000001e-05 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042042+0000", 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000140934 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.042068+0000", 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5262e-05 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.046406+0000", 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043385020000000002 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.657 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.046514+0000", 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107692 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 38/31 ECSubWrite(tid=51, reqid=osd.12.0:49, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.055448+0000", 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.551113555000001, 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061122040000000004, 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.658 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055448+0000", 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055448+0000", 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055449+0000", 2024-04-26T02:24:26.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1299999999999998e-07 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055471+0000", 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2456e-05 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055494+0000", 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2575999999999999e-05 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055518+0000", 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3879e-05 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055867+0000", 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034898900000000002 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.055876+0000", 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0899999999999994e-06 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061474+0000", 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0055981980000000004 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061560+0000", 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6102999999999999e-05 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 38/31 ECSubWrite(tid=69, reqid=osd.0.0:67, at_version=0'0, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056145+0000", 2024-04-26T02:24:26.662 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.550416582, 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0052890560000000003, 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056145+0000", 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056145+0000", 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056147+0000", 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7460000000000001e-06 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056175+0000", 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8212e-05 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056198+0000", 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3163000000000002e-05 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056219+0000", 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0971999999999998e-05 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056463+0000", 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024403700000000001 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056489+0000", 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5412999999999999e-05 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061351+0000", 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048626169999999996 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061434+0000", 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2896000000000001e-05 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.666 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056350+0000", 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.550212124000002, 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050521029999999996, 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056350+0000", 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056350+0000", 2024-04-26T02:24:26.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056351+0000", 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.13e-06 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056371+0000", 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0803000000000001e-05 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056395+0000", 2024-04-26T02:24:26.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3849000000000002e-05 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056413+0000", 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7946000000000001e-05 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056500+0000", 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7064999999999994e-05 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056512+0000", 2024-04-26T02:24:26.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1627000000000001e-05 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061274+0000", 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047622910000000001 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061402+0000", 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012739199999999999 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 38/31 ECSubWrite(tid=38, reqid=osd.8.0:38, at_version=38'31, trim_to=0'0, roll_forward_to=38'29))", 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:06.056855+0000", 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.549706811, 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048112490000000001, 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056855+0000", 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056855+0000", 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056856+0000", 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3030000000000001e-06 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056933+0000", 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6537000000000003e-05 2024-04-26T02:24:26.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056964+0000", 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0828999999999999e-05 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.056984+0000", 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0809e-05 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.057074+0000", 2024-04-26T02:24:26.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0158e-05 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.057084+0000", 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0969999999999995e-06 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061566+0000", 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0044824569999999996 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:06.061666+0000", 2024-04-26T02:24:26.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100059 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 42/31 ECSubWrite(tid=42, reqid=osd.8.0:42, at_version=42'35, trim_to=0'0, roll_forward_to=41'33))", 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.072164+0000", 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.534397197000001, 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049618880000000002, 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072164+0000", 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072164+0000", 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072165+0000", 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3700000000000001e-07 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072207+0000", 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.227e-05 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072224+0000", 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7088e-05 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072249+0000", 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4570999999999999e-05 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072367+0000", 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000117846 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.072389+0000", 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1832999999999999e-05 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.077054+0000", 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046658799999999999 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.077126+0000", 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1963000000000002e-05 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 49/31 ECSubWrite(tid=100, reqid=client.4589.0:333, at_version=49'36, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:16.494037+0000", 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.112524463, 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054707820000000004, 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.679 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494037+0000", 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494037+0000", 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494039+0000", 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.35e-06 2024-04-26T02:24:26.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494071+0000", 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2521999999999998e-05 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494099+0000", 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7815999999999999e-05 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494114+0000", 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4713e-05 2024-04-26T02:24:26.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494274+0000", 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016035499999999999 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.494292+0000", 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8130000000000001e-05 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.499345+0000", 2024-04-26T02:24:26.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050531409999999997 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:16.499508+0000", 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000162755 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/31 ECSubWrite(tid=116, reqid=client.4589.0:370, at_version=55'47, trim_to=0'0, roll_forward_to=51'45))", 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.485305+0000", 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.121256292, 2024-04-26T02:24:26.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084221049999999992, 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485305+0000", 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485305+0000", 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485306+0000", 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486017+0000", 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00071061799999999999 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486052+0000", 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4898999999999999e-05 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486075+0000", 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3349999999999998e-05 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486227+0000", 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015204899999999999 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486253+0000", 2024-04-26T02:24:26.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6143e-05 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.493628+0000", 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073744689999999998 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.493727+0000", 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9946999999999997e-05 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.687 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/31 ECSubWrite(tid=118, reqid=client.4589.0:372, at_version=55'49, trim_to=0'0, roll_forward_to=55'47))", 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.496383+0000", 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.1101787280000002, 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0053209950000000002, 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496383+0000", 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496383+0000", 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496385+0000", 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0140000000000001e-06 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496612+0000", 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022663699999999999 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496641+0000", 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9261999999999999e-05 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496664+0000", 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2853999999999998e-05 2024-04-26T02:24:26.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496820+0000", 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015675800000000001 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.496844+0000", 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3300000000000001e-05 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.501594+0000", 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047498729999999999 2024-04-26T02:24:26.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.501704+0000", 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110297 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/31 ECSubWrite(tid=125, reqid=client.4589.0:388, at_version=55'52, trim_to=0'0, roll_forward_to=55'50))", 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.757438+0000", 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8491240800000002, 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006111231, 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.692 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.757438+0000", 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.757438+0000", 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.757439+0000", 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.167e-06 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.758136+0000", 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00069723199999999999 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.758167+0000", 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1442000000000002e-05 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.758181+0000", 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3689000000000001e-05 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.758340+0000", 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015916699999999999 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.758381+0000", 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.0225000000000002e-05 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.695 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.763454+0000", 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050730009999999997 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.763549+0000", 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5308000000000003e-05 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/31 ECSubWrite(tid=126, reqid=client.4589.0:389, at_version=55'53, trim_to=0'0, roll_forward_to=55'50))", 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.760127+0000", 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 3.8464342, 2024-04-26T02:24:26.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048341629999999998, 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.760127+0000", 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.760127+0000", 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.760128+0000", 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.879999999999999e-07 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.760354+0000", 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000225367 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.760371+0000", 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7527e-05 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.760383+0000", 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1652e-05 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.761417+0000", 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010336410000000001 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.761440+0000", 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3805e-05 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.764885+0000", 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003444922 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.764962+0000", 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6260999999999994e-05 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:26.700 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:26.702 INFO:tasks.rados.rados.0.smithi175.stdout:195: expect (ObjNum 8 snap 0 seq_num 8) 2024-04-26T02:24:26.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:26.703 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:26.696+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:26.803 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:26.800+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:26.828 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:26.828 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:26.828 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:26.828 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:26.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:26.904 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:26.902+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:26.964 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:26.964 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:26.964 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:26.964 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:26.964 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:26.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:27.020 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:27.018+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:27.107 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:27.104+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.035020+0000", 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.103689067000001, 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096975120000000001, 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.142 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035020+0000", 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035020+0000", 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035022+0000", 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5430000000000001e-06 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035070+0000", 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8245000000000003e-05 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035099+0000", 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9416000000000001e-05 2024-04-26T02:24:27.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035122+0000", 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3218999999999999e-05 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036221+0000", 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001098506 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036289+0000", 2024-04-26T02:24:27.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7999999999999999e-05 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044636+0000", 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.008347396 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044717+0000", 2024-04-26T02:24:27.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1186999999999994e-05 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.041639+0000", 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.097069853000001, 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009070982, 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.147 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041639+0000", 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041639+0000", 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041641+0000", 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8160000000000001e-06 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041694+0000", 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3127999999999997e-05 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041727+0000", 2024-04-26T02:24:27.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2756000000000003e-05 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041748+0000", 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1229e-05 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042012+0000", 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026354900000000002 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.042034+0000", 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2138999999999999e-05 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050631+0000", 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085971450000000005 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050710+0000", 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9220000000000004e-05 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.151 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.153 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:405 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~770048] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.789801+0000", 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3489078750000001, 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0093141430000000004, 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.154 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 405 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.789801+0000", 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.789801+0000", 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.789804+0000", 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5189999999999999e-06 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.790633+0000", 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00082970099999999996 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.790662+0000", 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8603e-05 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.790676+0000", 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3616e-05 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.790805+0000", 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012968999999999999 2024-04-26T02:24:27.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.790949+0000", 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014329300000000001 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.792874+0000", 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001925202 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.798600+0000", 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057266460000000002 2024-04-26T02:24:27.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.798913+0000", 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031281599999999999 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.799115+0000", 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020205700000000001 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:406 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~475136] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3447050149999997, 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010860336999999999, 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 406 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794007+0000", 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4770000000000002e-06 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794660+0000", 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065313299999999997 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794694+0000", 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4014999999999999e-05 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794716+0000", 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2846000000000001e-05 2024-04-26T02:24:27.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795033+0000", 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000316965 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795302+0000", 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268853 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.797207+0000", 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019045690000000001 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803798+0000", 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006591281 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804729+0000", 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00093087200000000001 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804864+0000", 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013532600000000001 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:407 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~294912] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3432491310000003, 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010087191000000001, 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.165 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 407 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:27.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795462+0000", 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.674e-06 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795803+0000", 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034131400000000001 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795847+0000", 2024-04-26T02:24:27.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4518999999999998e-05 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795869+0000", 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1892e-05 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.799486+0000", 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0036169510000000002 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.799575+0000", 2024-04-26T02:24:27.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8862000000000004e-05 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.800084+0000", 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00050842200000000002 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803800+0000", 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037168539999999999 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805437+0000", 2024-04-26T02:24:27.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001636593 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805547+0000", 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011011 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:408 3.bs0 3:d145576f:::smithi17529564-17:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.342797343, 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010110317000000001, 2024-04-26T02:24:27.170 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 408 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795913+0000", 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7969999999999999e-06 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795923+0000", 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1970000000000002e-06 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795946+0000", 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3584999999999999e-05 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795962+0000", 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5503999999999999e-05 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.801481+0000", 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005519665 2024-04-26T02:24:27.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.801733+0000", 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025184099999999999 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803057+0000", 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013241139999999999 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805141+0000", 2024-04-26T02:24:27.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002083175 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805932+0000", 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079104900000000005 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806022+0000", 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0389999999999993e-05 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:409 3.bs0 3:d145576f:::smithi17529564-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3427205510000002, 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013475743, 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 409 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.176 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795990+0000", 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.42e-06 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795995+0000", 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5799999999999999e-06 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796017+0000", 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1778999999999999e-05 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796033+0000", 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6022999999999999e-05 2024-04-26T02:24:27.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806706+0000", 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010672472000000001 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806946+0000", 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024007 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809464+0000", 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025183990000000002 2024-04-26T02:24:27.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:411 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~802816] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.808490+0000", 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3302187090000004, 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0092652280000000004, 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.180 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 411 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.808490+0000", 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.808490+0000", 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.808492+0000", 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.488e-06 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809056+0000", 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00056372099999999999 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809068+0000", 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2865e-05 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809077+0000", 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1839999999999999e-06 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809534+0000", 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045694099999999999 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809712+0000", 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000178806 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.811570+0000", 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001858003 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.817602+0000", 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060318009999999998 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.817677+0000", 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4825000000000003e-05 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.817756+0000", 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8594e-05 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:412 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~638976] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.812785+0000", 2024-04-26T02:24:27.185 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3259244800000003, 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087415280000000001, 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 412 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.812785+0000", 2024-04-26T02:24:27.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.812785+0000", 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.812787+0000", 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.243e-06 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813247+0000", 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00046000099999999998 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813278+0000", 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1333e-05 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813293+0000", 2024-04-26T02:24:27.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4893e-05 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813582+0000", 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028889200000000001 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813836+0000", 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025445600000000002 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.815754+0000", 2024-04-26T02:24:27.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001917226 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821304+0000", 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005550442 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821455+0000", 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000151259 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821526+0000", 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0783000000000003e-05 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:413 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~131072] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.324903044, 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011855436, 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.191 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 413 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813808+0000", 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0200000000000001e-06 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813887+0000", 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9437999999999994e-05 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813913+0000", 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5082000000000001e-05 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813931+0000", 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.859e-05 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818168+0000", 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042373460000000003 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818314+0000", 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000145289 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819109+0000", 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079474400000000001 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825348+0000", 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062396159999999999 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825501+0000", 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152583 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825661+0000", 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016072800000000001 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:414 3.bs0 3:db601e58:::smithi17529564-10:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3247466709999998, 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012515695, 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.196 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 414 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813964+0000", 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.59e-06 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813973+0000", 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6689999999999995e-06 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813993+0000", 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0440000000000001e-05 2024-04-26T02:24:27.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814007+0000", 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4073000000000001e-05 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819880+0000", 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058725599999999998 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820055+0000", 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017564800000000001 2024-04-26T02:24:27.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820866+0000", 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000810299 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826013+0000", 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051474570000000002 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826385+0000", 2024-04-26T02:24:27.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00037209199999999997 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826478+0000", 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2867000000000004e-05 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:415 3.bs0 3:db601e58:::smithi17529564-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.3246822370000002, 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014775608000000001, 2024-04-26T02:24:27.201 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 415 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814028+0000", 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2270000000000001e-06 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814034+0000", 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6230000000000002e-06 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814070+0000", 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6513000000000001e-05 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814083+0000", 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.332e-05 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821842+0000", 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077589859999999998 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821934+0000", 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1736000000000004e-05 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826791+0000", 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048572470000000003 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826870+0000", 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8065999999999994e-05 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.828802+0000", 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00193289 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=132, reqid=osd.12.0:132, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566219+0000", 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.57248989800000005, 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084287800000000003, 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.206 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566219+0000", 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566219+0000", 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566221+0000", 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.153e-06 2024-04-26T02:24:27.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566261+0000", 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9975999999999998e-05 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566292+0000", 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0799000000000001e-05 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566315+0000", 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2866000000000001e-05 2024-04-26T02:24:27.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566516+0000", 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020062199999999999 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566540+0000", 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4746e-05 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571621+0000", 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050802929999999996 2024-04-26T02:24:27.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574648+0000", 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003027325 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.57056174699999995, 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01558203, 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.210 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568148+0000", 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5300000000000004e-07 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568196+0000", 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8158999999999997e-05 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568232+0000", 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5565999999999998e-05 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568269+0000", 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568551+0000", 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028192700000000001 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568576+0000", 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5171999999999999e-05 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583637+0000", 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015060841 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583729+0000", 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2570000000000003e-05 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.214 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.56916312999999996, 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015014527, 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569547+0000", 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-07 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569597+0000", 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0417999999999997e-05 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569626+0000", 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9087000000000001e-05 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569648+0000", 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1869e-05 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569790+0000", 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014197 2024-04-26T02:24:27.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569814+0000", 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3748999999999999e-05 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584483+0000", 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014669006 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584560+0000", 2024-04-26T02:24:27.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7785000000000001e-05 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.56361845200000005, 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010327464999999999, 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575092+0000", 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575136+0000", 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4712000000000002e-05 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575161+0000", 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4396000000000002e-05 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575179+0000", 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8445999999999999e-05 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575319+0000", 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013968699999999999 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575344+0000", 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5153000000000001e-05 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585327+0000", 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099826429999999994 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585418+0000", 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1471000000000006e-05 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.56346541299999997, 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012320048, 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.223 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575245+0000", 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1039999999999999e-06 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575287+0000", 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2122000000000001e-05 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575310+0000", 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3139999999999999e-05 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575328+0000", 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7932e-05 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575669+0000", 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340749 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575694+0000", 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587485+0000", 2024-04-26T02:24:27.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01179094 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587564+0000", 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8610999999999997e-05 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.56329364999999998, 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013969232, 2024-04-26T02:24:27.227 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575416+0000", 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6000000000000004e-07 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575457+0000", 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1006e-05 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575475+0000", 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8280000000000001e-05 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575492+0000", 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6455000000000001e-05 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575788+0000", 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029676700000000003 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575812+0000", 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3866000000000002e-05 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589304+0000", 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013491306999999999 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589385+0000", 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0990999999999998e-05 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:27.231 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.56239894099999999, 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013188284, 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576312+0000", 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.88e-06 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576362+0000", 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9518999999999998e-05 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576392+0000", 2024-04-26T02:24:27.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0278999999999999e-05 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576413+0000", 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0879000000000001e-05 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576631+0000", 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000217858 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576656+0000", 2024-04-26T02:24:27.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5230000000000001e-05 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589395+0000", 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012739034999999999 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589498+0000", 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010360400000000001 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=73, reqid=osd.8.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:24:27.235 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 0.54738921399999996, 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099689510000000002, 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:27.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591321+0000", 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6440000000000001e-06 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591346+0000", 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4842999999999999e-05 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591374+0000", 2024-04-26T02:24:27.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7705999999999999e-05 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591394+0000", 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0003000000000001e-05 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591560+0000", 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165966 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591587+0000", 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7291999999999999e-05 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601222+0000", 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096350700000000008 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601289+0000", 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6427000000000006e-05 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.240 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.240 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.240 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:27.241 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:27.242 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:27.240+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:27.343 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:27.340+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:27.368 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:27.368 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:27.368 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:27.368 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:27.381 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:27.444 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:27.439+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:24:27.458 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.8 to 1 (10000) 2024-04-26T02:24:27.464 INFO:tasks.rados.rados.0.smithi175.stdout:191: done (4 left) 2024-04-26T02:24:27.464 INFO:tasks.rados.rados.0.smithi175.stdout:192: done (3 left) 2024-04-26T02:24:27.464 INFO:tasks.rados.rados.0.smithi175.stdout:193: done (2 left) 2024-04-26T02:24:27.464 INFO:tasks.rados.rados.0.smithi175.stdout:195: done (1 left) 2024-04-26T02:24:27.464 INFO:tasks.rados.rados.0.smithi175.stdout:196: done (0 left) 2024-04-26T02:24:27.464 INFO:tasks.rados.rados.0.smithi175.stdout:197: setattr oid 30 current snap is 14 2024-04-26T02:24:27.466 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 2 current snap is 14 2024-04-26T02:24:27.467 INFO:tasks.rados.rados.0.smithi175.stdout:198: seq_num 105 ranges {32768=606208,638976=688128,1327104=475136} 2024-04-26T02:24:27.471 INFO:tasks.rados.rados.0.smithi175.stdout:198: writing smithi17529564-2 from 32768 to 638976 tid 1 2024-04-26T02:24:27.478 INFO:tasks.rados.rados.0.smithi175.stdout:198: writing smithi17529564-2 from 638976 to 1327104 tid 2 2024-04-26T02:24:27.483 INFO:tasks.rados.rados.0.smithi175.stdout:198: writing smithi17529564-2 from 1327104 to 1802240 tid 3 2024-04-26T02:24:27.483 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 36 current snap is 14 2024-04-26T02:24:27.484 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 54 (ObjNum 104 snap 13 seq_num 104) dirty exists 2024-04-26T02:24:27.484 INFO:tasks.rados.rados.0.smithi175.stdout:199: seq_num 106 ranges {589824=622592,1212416=442368,1654784=524288,2179072=196608} 2024-04-26T02:24:27.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-04-26T02:24:27.497 INFO:tasks.rados.rados.0.smithi175.stdout:199: writing smithi17529564-36 from 589824 to 1212416 tid 1 2024-04-26T02:24:27.502 INFO:tasks.rados.rados.0.smithi175.stdout:199: writing smithi17529564-36 from 1212416 to 1654784 tid 2 2024-04-26T02:24:27.508 INFO:tasks.rados.rados.0.smithi175.stdout:199: writing smithi17529564-36 from 1654784 to 2179072 tid 3 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:199: writing smithi17529564-36 from 2179072 to 2375680 tid 4 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:197: done (2 left) 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:200: snap_create 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:198: finishing write tid 1 to smithi17529564-2 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:198: finishing write tid 2 to smithi17529564-2 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:198: finishing write tid 3 to smithi17529564-2 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:198: finishing write tid 4 to smithi17529564-2 2024-04-26T02:24:27.511 INFO:tasks.rados.rados.0.smithi175.stdout:198: finishing write tid 5 to smithi17529564-2 2024-04-26T02:24:27.512 INFO:tasks.rados.rados.0.smithi175.stdout:198: oid 2 updating version 0 to 35 2024-04-26T02:24:27.512 INFO:tasks.rados.rados.0.smithi175.stdout:198: oid 2 updating version 35 to 36 2024-04-26T02:24:27.512 INFO:tasks.rados.rados.0.smithi175.stdout:198: oid 2 version 36 is already newer than 34 2024-04-26T02:24:27.512 INFO:tasks.rados.rados.0.smithi175.stdout:198: oid 2 version 36 is already newer than 33 2024-04-26T02:24:27.512 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 2 v 36 (ObjNum 105 snap 14 seq_num 105) dirty exists 2024-04-26T02:24:27.512 INFO:tasks.rados.rados.0.smithi175.stdout:198: left oid 2 (ObjNum 105 snap 14 seq_num 105) 2024-04-26T02:24:27.512 INFO:tasks.rados.rados.0.smithi175.stdout:199: finishing write tid 1 to smithi17529564-36 2024-04-26T02:24:27.512 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:27.512 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:27.512 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:27.514 INFO:tasks.rados.rados.0.smithi175.stdout:199: finishing write tid 2 to smithi17529564-36 2024-04-26T02:24:27.520 INFO:tasks.rados.rados.0.smithi175.stdout:199: finishing write tid 3 to smithi17529564-36 2024-04-26T02:24:27.521 INFO:tasks.rados.rados.0.smithi175.stdout:199: finishing write tid 4 to smithi17529564-36 2024-04-26T02:24:27.521 INFO:tasks.rados.rados.0.smithi175.stdout:199: finishing write tid 5 to smithi17529564-36 2024-04-26T02:24:27.526 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:24:27.527 INFO:tasks.rados.rados.0.smithi175.stdout:199: finishing write tid 6 to smithi17529564-36 2024-04-26T02:24:27.527 INFO:tasks.rados.rados.0.smithi175.stdout:199: oid 36 updating version 0 to 30 2024-04-26T02:24:27.527 INFO:tasks.rados.rados.0.smithi175.stdout:199: oid 36 version 30 is already newer than 28 2024-04-26T02:24:27.527 INFO:tasks.rados.rados.0.smithi175.stdout:199: oid 36 version 30 is already newer than 27 2024-04-26T02:24:27.527 INFO:tasks.rados.rados.0.smithi175.stdout:199: oid 36 updating version 30 to 31 2024-04-26T02:24:27.528 INFO:tasks.rados.rados.0.smithi175.stdout:199: oid 36 version 31 is already newer than 29 2024-04-26T02:24:27.528 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 36 v 31 (ObjNum 106 snap 14 seq_num 106) dirty exists 2024-04-26T02:24:27.528 INFO:tasks.rados.rados.0.smithi175.stdout:199: left oid 36 (ObjNum 106 snap 14 seq_num 106) 2024-04-26T02:24:27.544 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:27.539+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:27.646 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:27.643+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.9s5 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.043254+0000", 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.605990994999999, 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067741770000000001, 2024-04-26T02:24:27.652 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043254+0000", 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043254+0000", 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043255+0000", 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7299999999999995e-07 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043311+0000", 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6137999999999997e-05 2024-04-26T02:24:27.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043354+0000", 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2624999999999999e-05 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.043379+0000", 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5049e-05 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044138+0000", 2024-04-26T02:24:27.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00075887600000000002 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.044165+0000", 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6896000000000001e-05 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049942+0000", 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005777524 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.656 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.050029+0000", 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6396000000000004e-05 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:276 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.490785705, 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015591825, 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.657 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 276 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.658 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158464+0000", 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4240000000000003e-06 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158778+0000", 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031355400000000001 2024-04-26T02:24:27.659 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158793+0000", 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5654e-05 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158804+0000", 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0543000000000001e-05 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158964+0000", 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015994199999999999 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.660 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.159116+0000", 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152194 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161895+0000", 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027785510000000002 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173835+0000", 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011940014000000001 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.661 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173974+0000", 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000139546 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174052+0000", 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7403000000000004e-05 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.662 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:277 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.485066005, 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010157334000000001, 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.663 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 277 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:27.664 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164186+0000", 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-06 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164969+0000", 2024-04-26T02:24:27.665 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00078311199999999998 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165008+0000", 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9104999999999999e-05 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165032+0000", 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4309000000000001e-05 2024-04-26T02:24:27.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167127+0000", 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020944959999999999 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167367+0000", 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023982499999999999 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.169580+0000", 2024-04-26T02:24:27.667 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022133669999999999 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173836+0000", 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042559579999999998 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174288+0000", 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045227899999999998 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.668 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174337+0000", 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8452999999999998e-05 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:278 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~262144] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.484175053000001, 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012417243999999999, 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.669 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 278 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.670 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165072+0000", 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.956e-06 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165417+0000", 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034496100000000002 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.671 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165440+0000", 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2768999999999998e-05 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165455+0000", 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4537e-05 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.170890+0000", 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054354399999999997 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.672 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171115+0000", 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000224634 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.172663+0000", 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001548334 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175132+0000", 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002469073 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.673 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.177317+0000", 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021844920000000001 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.177488+0000", 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017104800000000001 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:279 3.1s0 3:8c97d9d7:::smithi17529564-6:head [setxattr _header (55) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:27.674 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.483767738000001, 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012771915999999999, 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 279 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:27.675 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165479+0000", 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.113e-06 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.676 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165484+0000", 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7940000000000002e-06 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165496+0000", 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2388999999999999e-05 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165504+0000", 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3960000000000006e-06 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.677 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174364+0000", 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088599820000000006 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174434+0000", 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9259999999999998e-05 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174903+0000", 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00046937200000000002 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.678 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175519+0000", 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00061567900000000005 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.178064+0000", 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025453030000000001 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.178250+0000", 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018562799999999999 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.679 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:280 3.1s0 3:8c97d9d7:::smithi17529564-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.483727676000001, 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018442278999999999, 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 280 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165519+0000", 2024-04-26T02:24:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165523+0000", 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9400000000000004e-06 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165535+0000", 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2486e-05 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165546+0000", 2024-04-26T02:24:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175360+0000", 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098140950000000001 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175447+0000", 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7737000000000004e-05 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179821+0000", 2024-04-26T02:24:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043734860000000002 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179966+0000", 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014539199999999999 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183960+0000", 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039937430000000001 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:422 3.1s0 3:80641982:::smithi17529564-25:head [copy-from ver 55] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8175077039999996, 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.038918576000000003, 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 422 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831740+0000", 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5440000000000001e-06 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831752+0000", 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2041999999999999e-05 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831781+0000", 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8833999999999999e-05 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831794+0000", 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3349e-05 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831860+0000", 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5356000000000002e-05 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831926+0000", 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6396000000000006e-05 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.859553+0000", 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027626301999999998 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866678+0000", 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007125803 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870520+0000", 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003841952 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870656+0000", 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013599799999999999 2024-04-26T02:24:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:423 3.1s0 3:80641982:::smithi17529564-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 4.8174238630000001, 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.034213080999999999, 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 423 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831827+0000", 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.792e-06 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831839+0000", 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1712000000000001e-05 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.692 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831846+0000", 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9199999999999998e-06 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832063+0000", 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021765599999999999 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for blocked object", 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832133+0000", 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9449999999999994e-05 2024-04-26T02:24:27.693 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865896+0000", 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.033763107000000001 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865962+0000", 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5810999999999997e-05 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.694 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866035+0000", 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2782999999999998e-05 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es4 59/31 ECSubWrite(tid=77, reqid=osd.13.0:77, at_version=59'24, trim_to=0'0, roll_forward_to=58'22))", 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.560649+0000", 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.088595921, 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007460843, 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.695 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.560649+0000", 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.560649+0000", 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.560651+0000", 2024-04-26T02:24:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.094e-06 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.560699+0000", 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8427999999999998e-05 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.560721+0000", 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2289999999999998e-05 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.697 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.560739+0000", 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7972999999999999e-05 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562079+0000", 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001339448 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562094+0000", 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5193e-05 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.698 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568026+0000", 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059319159999999998 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568110+0000", 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4500999999999996e-05 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:503 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:24:27.699 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.0865381810000001, 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019134271000000001, 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 503 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.700 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562709+0000", 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1500000000000002e-06 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.701 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562720+0000", 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0746e-05 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562740+0000", 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0370999999999999e-05 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562753+0000", 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2561999999999999e-05 2024-04-26T02:24:27.702 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562867+0000", 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113841 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562881+0000", 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3709999999999999e-05 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569080+0000", 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061992339999999996 2024-04-26T02:24:27.703 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569415+0000", 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033499799999999998 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581842+0000", 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012426659 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.704 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:504 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.0864657870000001, 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020273925000000002, 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 504 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.705 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562781+0000", 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.706 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562797+0000", 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6254000000000001e-05 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562809+0000", 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2204e-05 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562818+0000", 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8459999999999997e-06 2024-04-26T02:24:27.707 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562987+0000", 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016880399999999999 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562997+0000", 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0713000000000001e-05 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.708 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570438+0000", 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007440894 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570691+0000", 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025249400000000003 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583054+0000", 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012362720000000001 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.709 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:505 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.0864116100000001, 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.032520136999999998, 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:27.710 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 505 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.711 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562835+0000", 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0200000000000001e-07 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562839+0000", 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5839999999999996e-06 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562853+0000", 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4216000000000001e-05 2024-04-26T02:24:27.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562864+0000", 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0579e-05 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563046+0000", 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018216799999999999 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563058+0000", 2024-04-26T02:24:27.713 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1378e-05 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571720+0000", 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086620359999999997 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571999+0000", 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027927099999999999 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.714 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595354+0000", 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023355102999999999 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpRead(3.1s0 59/31 ECSubRead(tid=44, to_read={3:84b104fd:::smithi17529564-9:head=0,36864,0}, subchunks={3:84b104fd:::smithi17529564-9:head=[0,1]}, attrs_to_read=))", 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.077939607, 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014360293, 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.715 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:27.716 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571606+0000", 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029980300000000002 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571627+0000", 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1239000000000001e-05 2024-04-26T02:24:27.717 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575588+0000", 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039609429999999998 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585666+0000", 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010078307999999999 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.718 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.9s5 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572282+0000", 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.0769637729999999, 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083266190000000004, 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572282+0000", 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.719 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572282+0000", 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572284+0000", 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0870000000000001e-06 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572311+0000", 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7129000000000001e-05 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.720 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572345+0000", 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3809000000000001e-05 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572366+0000", 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1696e-05 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573681+0000", 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013150289999999999 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.721 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573709+0000", 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7699e-05 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580525+0000", 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006816328 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580608+0000", 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2842000000000004e-05 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.722 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpRead(3.1s0 59/31 ECSubRead(tid=45, to_read={3:84b104fd:::smithi17529564-9:head=0,36864,0}, subchunks={3:84b104fd:::smithi17529564-9:head=[0,1]}, attrs_to_read=))", 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572698+0000", 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.076547586, 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0076001159999999996, 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572698+0000", 2024-04-26T02:24:27.723 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572698+0000", 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572698+0000", 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572698+0000", 2024-04-26T02:24:27.724 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573324+0000", 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00062571800000000004 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573350+0000", 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6896000000000001e-05 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.725 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580002+0000", 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066517659999999999 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580298+0000", 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000295736 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=43, attrs_read=0))", 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.573563+0000", 2024-04-26T02:24:27.726 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.075682504, 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072224089999999999, 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573563+0000", 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573563+0000", 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.727 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573563+0000", 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573563+0000", 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573608+0000", 2024-04-26T02:24:27.728 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4916000000000002e-05 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573627+0000", 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9579999999999999e-05 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580678+0000", 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0070504319999999997 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580785+0000", 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000107481 2024-04-26T02:24:27.729 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=43, attrs_read=0))", 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.573797+0000", 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.0754482620000001, 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0072921399999999999, 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.730 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573797+0000", 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573797+0000", 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573799+0000", 2024-04-26T02:24:27.731 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.753e-06 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574118+0000", 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000319079 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574160+0000", 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2358999999999999e-05 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574176+0000", 2024-04-26T02:24:27.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5909999999999998e-05 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580994+0000", 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068179180000000001 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581089+0000", 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5120999999999999e-05 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=44, attrs_read=0))", 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574404+0000", 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.0748410740000001, 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079683649999999998, 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574404+0000", 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574404+0000", 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574406+0000", 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.187e-06 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574521+0000", 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011578000000000001 2024-04-26T02:24:27.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574545+0000", 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3397e-05 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574562+0000", 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7102e-05 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.582262+0000", 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077001680000000003 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.582373+0000", 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011073099999999999 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=45, attrs_read=0))", 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574589+0000", 2024-04-26T02:24:27.737 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.0746566150000001, 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087970289999999996, 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574589+0000", 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574589+0000", 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574590+0000", 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0499999999999999e-06 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574679+0000", 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9362000000000003e-05 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574699+0000", 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0134999999999999e-05 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574713+0000", 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3164e-05 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583295+0000", 2024-04-26T02:24:27.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085828369999999994 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583386+0000", 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0481000000000003e-05 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=45, attrs_read=0))", 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.06897244, 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015110926, 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:27.741 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:27.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:27.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584305+0000", 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040320649999999996 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584322+0000", 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7076e-05 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594641+0000", 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010319246000000001 2024-04-26T02:24:27.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595384+0000", 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074253899999999996 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:27.745 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:27.747 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:24:27.747 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:27.743+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:27.848 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:27.844+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:27.876 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:27.876 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:27.876 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:27.876 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:27.891 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:24:27.949 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:27.944+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:28.008 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:28.008 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:28.008 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:28.009 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:28.009 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:28.022 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:24:28.067 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:28.066+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:28.142 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.104162622, 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0094430320000000005, 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.143 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035735+0000", 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8330000000000001e-06 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035787+0000", 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2111000000000003e-05 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035818+0000", 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0599000000000003e-05 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035841+0000", 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2889000000000001e-05 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036181+0000", 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340057 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036195+0000", 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4769e-05 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045085+0000", 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088895439999999992 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045176+0000", 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1230000000000006e-05 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:28.147 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.101733705000001, 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095415010000000008, 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038163+0000", 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7999999999999995e-07 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038217+0000", 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4588e-05 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038250+0000", 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2628e-05 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038274+0000", 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4256e-05 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038532+0000", 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025780300000000003 2024-04-26T02:24:28.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038556+0000", 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3811999999999998e-05 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047633+0000", 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090777800000000006 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047704+0000", 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0054000000000004e-05 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.099345287999999, 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089888439999999993, 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.152 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040551+0000", 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6199999999999999e-07 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040593+0000", 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2224000000000001e-05 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040614+0000", 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0746000000000001e-05 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040630+0000", 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6441999999999999e-05 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041176+0000", 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00054610900000000003 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041224+0000", 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7712e-05 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049439+0000", 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082147729999999999 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049539+0000", 2024-04-26T02:24:28.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100476 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.099231658000001, 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087839709999999998, 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040665+0000", 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3399999999999998e-07 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040718+0000", 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2923999999999997e-05 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040748+0000", 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0709e-05 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040771+0000", 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2636000000000001e-05 2024-04-26T02:24:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041006+0000", 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023521999999999999 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041030+0000", 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3736000000000001e-05 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049357+0000", 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083271030000000006 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049448+0000", 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909000000000007e-05 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.161 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.099228388, 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012142201, 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.162 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040668+0000", 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2699999999999998e-07 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040700+0000", 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1668999999999998e-05 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040714+0000", 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4517e-05 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040730+0000", 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6030000000000001e-05 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046667+0000", 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059366619999999997 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046693+0000", 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5769e-05 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052718+0000", 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060254139999999998 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052810+0000", 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1312999999999998e-05 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.165 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.048020+0000", 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.091875473000002, 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0076681650000000002, 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048020+0000", 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048020+0000", 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048021+0000", 2024-04-26T02:24:28.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.153e-06 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048065+0000", 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3198000000000002e-05 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048090+0000", 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5469e-05 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.048110+0000", 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9882999999999999e-05 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049070+0000", 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00096005799999999996 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049092+0000", 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2249e-05 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.055465+0000", 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0063729310000000001 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.055688+0000", 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000223224 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:261 3.6s0 3:67e91997:::smithi17529564-21:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:28.170 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:28.171 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.012589487, 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097788909999999996, 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 261 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127307+0000", 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2399999999999998e-07 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127310+0000", 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.021e-06 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127316+0000", 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9309999999999996e-06 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127321+0000", 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2020000000000003e-06 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129502+0000", 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002180586 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129561+0000", 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9558000000000001e-05 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129830+0000", 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268829 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.131759+0000", 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019285280000000001 2024-04-26T02:24:28.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.136744+0000", 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049853220000000004 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.137085+0000", 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034129000000000001 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:262 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 18.012555624000001, 2024-04-26T02:24:28.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013830606, 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 262 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:28.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127341+0000", 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5300000000000004e-07 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127343+0000", 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4399999999999999e-06 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127349+0000", 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2369999999999997e-06 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127356+0000", 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1600000000000001e-06 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129990+0000", 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026331509999999998 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.130041+0000", 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1842999999999998e-05 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138025+0000", 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079837410000000008 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138259+0000", 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023420799999999999 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.141171+0000", 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029112729999999998 2024-04-26T02:24:28.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:273 3.6s0 3:687a1e37:::smithi17529564-28:head [append 0~770048] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.985407610999999, 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086583819999999992, 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:28.186 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 273 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154491+0000", 2024-04-26T02:24:28.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.717e-06 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155144+0000", 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065291999999999998 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155176+0000", 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2135000000000003e-05 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155197+0000", 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1146e-05 2024-04-26T02:24:28.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155809+0000", 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00061185199999999997 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155971+0000", 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016195700000000001 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158718+0000", 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002747453 2024-04-26T02:24:28.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161464+0000", 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00274567 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163030+0000", 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001566121 2024-04-26T02:24:28.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163146+0000", 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011641099999999999 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.191 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:274 3.6s0 3:687a1e37:::smithi17529564-28:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.984650418000001, 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090195850000000001, 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 274 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155247+0000", 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4300000000000001e-06 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155253+0000", 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0560000000000001e-06 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155265+0000", 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2407e-05 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155275+0000", 2024-04-26T02:24:28.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0149000000000001e-05 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160233+0000", 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049580379999999997 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160381+0000", 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000147207 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160878+0000", 2024-04-26T02:24:28.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049781399999999996 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163164+0000", 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002285881 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164154+0000", 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00098951799999999999 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164265+0000", 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000111085 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:275 3.6s0 3:687a1e37:::smithi17529564-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.984580467000001, 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011804706999999999, 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:28.197 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 275 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:28.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155316+0000", 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2299999999999999e-07 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155320+0000", 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.49e-06 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155331+0000", 2024-04-26T02:24:28.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.136e-05 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155343+0000", 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2369e-05 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162104+0000", 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067605010000000004 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:28.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162345+0000", 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000240669 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164877+0000", 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002532075 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:28.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165083+0000", 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020615600000000001 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167120+0000", 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020371640000000002 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/31 ECSubWrite(tid=116, reqid=client.4589.0:370, at_version=55'47, trim_to=0'0, roll_forward_to=51'45))", 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:28.202 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.6540534039999999, 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0093206069999999999, 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485843+0000", 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2600000000000002e-07 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486710+0000", 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000867617 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486747+0000", 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6479000000000001e-05 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486769+0000", 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2495999999999999e-05 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486936+0000", 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016618899999999999 2024-04-26T02:24:28.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486963+0000", 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6936000000000001e-05 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.495030+0000", 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0080676740000000004 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.495163+0000", 2024-04-26T02:24:28.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013269000000000001 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:383 3.6s0 3:638d7cd2:::smithi17529564-47:head [create,setxattr W^e]Xa\\QrOSaaTXbfV[Shi]\\Y^cPW]lnfeosltRr (1085) in=40b,setxattr hTkl`^NSUgdbSagao\\hnmPXaSYeN_XR_ZOS`cYVa (3368) in=40b,setxattr ]aqlRjO^YXj_kS[PsXNQ_TYdXgp]NOU`fV\\WW^hb (1506) in=40b,setxattr kdYha]pibVahqgkhsYcYR\\VZRjgtrZcTmT[rd[b` (137) in=40b,setxattr d`OriSSVdQdTf^sSVpPZ_ZpT[OcsaUd]o\\Q^NSV_ (1681) in=40b,setxattr pTXSsTp`Zd`WP]lRn_UlYVoVk]WgpokaRqT\\QOVT (840) in=40b,setxattr VWRnm\\bWPesi_gOgOZjOYbUcoegNn_oVpt]tfXZN (1543) in=40b,setxattr NjTckWUfWPjtUi^`Qpkna]XslXbbsZYmntac\\\\Pf (1858) in=40b,setxattr PNV^lSTnchlWZVYSjTNp\\go[aqV]pRX[jOQ\\rpUj (1470) in=40b,setxattr cqphOO\\af\\[Z (19016) in=12b,setxattr ^VrtbXYRWYdcjUfpjhg[]\\cclZfZi^QahnX[rkao (1891) in=40b,setxattr f_m]ncPklgV]akqfe`ZZRaaj[`N_b^TgoOlQnm^S (1507) in=40b,setxattr WiiY]UhUc]i\\WNisQPipi_m^_ftioS_SZfm[Sr[^ (1684) in=40b,setxattr Qla_okbjVjrN]ndRpSq`tX_ggr\\Yipk`[OYX^RfU (631) in=40b,setxattr RpfcObdt_YeTZXfPXcnk^nZqS_iOsqW^Tldl`bZO (1893) in=40b,setxattr l_PpNWgefdZpminrdnZ[kt_YrmrfWdjtoUVea_Qm (6944) in=40b,setxattr esb\\ObrYN[\\TQqi^ZNktnRWtmYZ^coRfNnYirTsa (10104) in=40b,setxattr Q (19016) in=1b,setxattr eoZZNVNjPT[taQ\\TPiheV]pVcrdj[njRRWmhdbjO (8912) in=40b,setxattr Uqkp[eagUe`SeNeNodPjsZ_epZSV_jr[NpWe[Sad (1086) in=40b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.723471+0000", 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.4164243870000002, 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082980250000000005, 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:28.207 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 383 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723471+0000", 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723471+0000", 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723475+0000", 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9199999999999997e-06 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723538+0000", 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3207999999999995e-05 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723572+0000", 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3793e-05 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723589+0000", 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6296000000000001e-05 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723752+0000", 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016314899999999999 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.724074+0000", 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032243799999999998 2024-04-26T02:24:28.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.726612+0000", 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025379619999999999 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.729410+0000", 2024-04-26T02:24:28.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027977620000000001 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.731478+0000", 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020681779999999999 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.731769+0000", 2024-04-26T02:24:28.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029131900000000001 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.5679666999999999, 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01458187, 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571930+0000", 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.08e-06 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571981+0000", 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0992000000000002e-05 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572011+0000", 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0266000000000001e-05 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572031+0000", 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9380000000000001e-05 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573094+0000", 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010632339999999999 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573112+0000", 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8323000000000001e-05 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586418+0000", 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013305783999999999 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586511+0000", 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2811000000000003e-05 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.5654953659999999, 2024-04-26T02:24:28.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012103983, 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:28.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574401+0000", 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574452+0000", 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0785999999999998e-05 2024-04-26T02:24:28.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574483+0000", 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1012000000000001e-05 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574507+0000", 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3666999999999999e-05 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574610+0000", 2024-04-26T02:24:28.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010356 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574620+0000", 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0212e-05 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586431+0000", 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011810467999999999 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586504+0000", 2024-04-26T02:24:28.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3558000000000003e-05 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.0s6 59/31 ECSubWrite(tid=37, reqid=osd.1.0:37, at_version=59'25, trim_to=0'0, roll_forward_to=51'23))", 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.565300607, 2024-04-26T02:24:28.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01197989, 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574596+0000", 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.034e-06 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574638+0000", 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1389e-05 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574659+0000", 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1732000000000001e-05 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574671+0000", 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1737e-05 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574820+0000", 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014874899999999999 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574845+0000", 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.497e-05 2024-04-26T02:24:28.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586519+0000", 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0116744 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586575+0000", 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5878999999999998e-05 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.226 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 59/31 ECSubWrite(tid=79, reqid=osd.13.0:77, at_version=0'0, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.5638100860000002, 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015265225, 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576087+0000", 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.33e-07 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576116+0000", 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9782999999999999e-05 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576138+0000", 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1696e-05 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576172+0000", 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3872999999999999e-05 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578894+0000", 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002721986 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578918+0000", 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4042000000000001e-05 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591165+0000", 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012247417 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591351+0000", 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018549500000000001 2024-04-26T02:24:28.230 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.5634478679999999, 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015022990999999999, 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576450+0000", 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.72e-06 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576517+0000", 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7062000000000003e-05 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576552+0000", 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5466000000000002e-05 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576573+0000", 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0835999999999998e-05 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576692+0000", 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119474 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576717+0000", 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5032e-05 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591376+0000", 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014658857000000001 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591471+0000", 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4543999999999995e-05 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.bs1 59/31 ECSubWrite(tid=32, reqid=osd.7.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=59'21))", 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.559738882, 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011853449, 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.235 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580158+0000", 2024-04-26T02:24:28.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5570000000000001e-06 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580183+0000", 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4272000000000001e-05 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580213+0000", 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0003000000000001e-05 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580249+0000", 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5942999999999998e-05 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580419+0000", 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017053200000000001 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580445+0000", 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5452999999999998e-05 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591931+0000", 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011486194 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592010+0000", 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9494999999999997e-05 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 59/31 ECSubWrite(tid=73, reqid=osd.8.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.590711+0000", 2024-04-26T02:24:28.239 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.549184535, 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007644634, 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.590711+0000", 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.590711+0000", 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:28.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.590713+0000", 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.646e-06 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.590764+0000", 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1085000000000003e-05 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.590794+0000", 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0340000000000001e-05 2024-04-26T02:24:28.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.590815+0000", 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0732000000000001e-05 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591091+0000", 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027628100000000002 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:28.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591119+0000", 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7722e-05 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.598263+0000", 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071442500000000004 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.598356+0000", 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2577999999999994e-05 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.243 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.244 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:28.244 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:28.244 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:28.245 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:24:28.246 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:28.239+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:28.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:28.346 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:28.344+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:28.381 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:28.381 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:28.381 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:28.381 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:28.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:24:28.444 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:28.445 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:28.447 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:28.444+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:28.459 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.9 to 1 (10000) 2024-04-26T02:24:28.467 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:28.467 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:28.468 INFO:tasks.rados.rados.0.smithi175.stdout:198: done (2 left) 2024-04-26T02:24:28.468 INFO:tasks.rados.rados.0.smithi175.stdout:199: done (1 left) 2024-04-26T02:24:28.468 INFO:tasks.rados.rados.0.smithi175.stdout:200: done (0 left) 2024-04-26T02:24:28.468 INFO:tasks.rados.rados.0.smithi175.stdout:201: rollback oid 10 current snap is 15 2024-04-26T02:24:28.468 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 10 to 11 2024-04-26T02:24:28.468 INFO:tasks.rados.rados.0.smithi175.stdout:202: snap_create 2024-04-26T02:24:28.481 INFO:tasks.rados.rados.0.smithi175.stdout:201: finishing rollback tid 0 to smithi17529564-10 2024-04-26T02:24:28.482 INFO:tasks.rados.rados.0.smithi175.stdout:201: finishing rollback tid 1 to smithi17529564-10 2024-04-26T02:24:28.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-04-26T02:24:28.484 INFO:tasks.rados.rados.0.smithi175.stdout:201: finishing rollback tid 2 to smithi17529564-10 2024-04-26T02:24:28.484 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 10 v 25 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-04-26T02:24:28.492 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:28.492 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:28.512 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:28.513 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:28.530 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:28.532 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:28.533 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:28.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:24:28.549 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:28.548+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:28.552 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:28.552 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:28.573 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:28.574 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:28.594 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:28.595 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:28.616 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:28.616 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:28.637 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:28.637 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:28.648 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:28.648+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:28.658 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:28.658 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:28.671 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:28.671 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:28.680 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:28.680 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:28.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:24:28.697 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:28.718 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:28.718 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:28.739 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:28.740+0000 7f3ae58b4640 0 -- 172.21.15.59:0/4224074309 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f3ae0225a30 msgr2=0x7f3ae0227e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:28.749 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:28.744+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:28.816 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:28.817 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:28.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:24:28.851 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:28.848+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:28.952 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:28.952+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:28.966 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:28.966 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:28.998 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:28.998 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:29.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:24:29.056 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:29.056+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:29.154 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:29.151+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:29.182 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:29.182 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:29.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:24:29.254 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:29.251+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:29.324 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:29.324 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:29.338 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:24:29.384 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:29.384+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:29.456 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:29.451+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.10 to 1 (10000) 2024-04-26T02:24:29.464 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:29.465 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:29.468 INFO:tasks.rados.rados.0.smithi175.stdout:201: done (1 left) 2024-04-26T02:24:29.469 INFO:tasks.rados.rados.0.smithi175.stdout:202: done (0 left) 2024-04-26T02:24:29.469 INFO:tasks.rados.rados.0.smithi175.stdout:203: delete oid 45 current snap is 16 2024-04-26T02:24:29.477 INFO:tasks.rados.rados.0.smithi175.stdout:203: done (0 left) 2024-04-26T02:24:29.478 INFO:tasks.rados.rados.0.smithi175.stdout:204: copy_from oid 31 from oid 26 current snap is 16 2024-04-26T02:24:29.478 INFO:tasks.rados.rados.0.smithi175.stdout:205: rmattr oid 39 current snap is 16 2024-04-26T02:24:29.478 INFO:tasks.rados.rados.0.smithi175.stdout:206: rollback oid 47 current snap is 16 2024-04-26T02:24:29.478 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 47 to 15 2024-04-26T02:24:29.478 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 46 current snap is 16 2024-04-26T02:24:29.479 INFO:tasks.rados.rados.0.smithi175.stdout:207: seq_num 108 ranges {4587520=655360,5242880=606208,5849088=475136,6324224=81920} 2024-04-26T02:24:29.487 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:24:29.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:24:29.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-04-26T02:24:29.551 INFO:tasks.rados.rados.0.smithi175.stdout:207: writing smithi17529564-46 from 4587520 to 5242880 tid 1 2024-04-26T02:24:29.558 INFO:tasks.rados.rados.0.smithi175.stdout:207: writing smithi17529564-46 from 5242880 to 5849088 tid 2 2024-04-26T02:24:29.562 INFO:tasks.rados.rados.0.smithi175.stdout:207: writing smithi17529564-46 from 5849088 to 6324224 tid 3 2024-04-26T02:24:29.563 INFO:tasks.rados.rados.0.smithi175.stdout:207: writing smithi17529564-46 from 6324224 to 6406144 tid 4 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:208: read oid 6 snap -1 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:208: expect (ObjNum 102 snap 13 seq_num 102) 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:209: rmattr oid 12 current snap is 16 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:209: done (5 left) 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:210: delete oid 50 current snap is 16 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:206: finishing rollback tid 0 to smithi17529564-47 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 39 v 38 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:206: finishing rollback tid 1 to smithi17529564-47 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:206: finishing rollback tid 2 to smithi17529564-47 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 56 (ObjNum 96 snap 13 seq_num 96) dirty exists 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:204: finishing copy_from racing read to smithi17529564-31 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:204: finishing copy_from to smithi17529564-31 2024-04-26T02:24:29.564 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 31 v 36 (ObjNum 87 snap 12 seq_num 87) dirty exists 2024-04-26T02:24:29.565 INFO:tasks.rados.rados.0.smithi175.stdout:207: finishing write tid 1 to smithi17529564-46 2024-04-26T02:24:29.565 INFO:tasks.rados.rados.0.smithi175.stdout:207: finishing write tid 2 to smithi17529564-46 2024-04-26T02:24:29.570 INFO:tasks.rados.rados.0.smithi175.stdout:207: finishing write tid 3 to smithi17529564-46 2024-04-26T02:24:29.571 INFO:tasks.rados.rados.0.smithi175.stdout:207: finishing write tid 4 to smithi17529564-46 2024-04-26T02:24:29.574 INFO:tasks.rados.rados.0.smithi175.stdout:207: finishing write tid 5 to smithi17529564-46 2024-04-26T02:24:29.575 INFO:tasks.rados.rados.0.smithi175.stdout:207: finishing write tid 6 to smithi17529564-46 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:207: oid 46 updating version 0 to 83 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:207: oid 46 version 83 is already newer than 81 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:207: oid 46 updating version 83 to 84 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:207: oid 46 version 84 is already newer than 82 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:207: oid 46 updating version 84 to 85 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 46 v 85 (ObjNum 108 snap 16 seq_num 108) dirty exists 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:207: left oid 46 (ObjNum 108 snap 16 seq_num 108) 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:204: done (5 left) 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:205: done (4 left) 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:206: done (3 left) 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:207: done (2 left) 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:210: done (1 left) 2024-04-26T02:24:29.576 INFO:tasks.rados.rados.0.smithi175.stdout:211: delete oid 11 current snap is 16 2024-04-26T02:24:29.584 INFO:tasks.rados.rados.0.smithi175.stdout:211: done (1 left) 2024-04-26T02:24:29.584 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 41 current snap is 16 2024-04-26T02:24:29.584 INFO:tasks.rados.rados.0.smithi175.stdout:212: seq_num 111 ranges {688128=704512,1392640=655360,2048000=507904} 2024-04-26T02:24:29.588 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:29.588+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:29.599 INFO:tasks.rados.rados.0.smithi175.stdout:212: writing smithi17529564-41 from 688128 to 1392640 tid 1 2024-04-26T02:24:29.606 INFO:tasks.rados.rados.0.smithi175.stdout:212: writing smithi17529564-41 from 1392640 to 2048000 tid 2 2024-04-26T02:24:29.611 INFO:tasks.rados.rados.0.smithi175.stdout:212: writing smithi17529564-41 from 2048000 to 2555904 tid 3 2024-04-26T02:24:29.611 INFO:tasks.rados.rados.0.smithi175.stdout:213: delete oid 5 current snap is 16 2024-04-26T02:24:29.611 INFO:tasks.rados.rados.0.smithi175.stdout:212: finishing write tid 1 to smithi17529564-41 2024-04-26T02:24:29.612 INFO:tasks.rados.rados.0.smithi175.stdout:208: expect (ObjNum 102 snap 13 seq_num 102) 2024-04-26T02:24:29.657 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:29.652+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:29.676 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:29.677 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:29.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:24:29.758 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:29.756+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:29.818 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:29.818 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:29.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:24:29.840 INFO:tasks.rados.rados.0.smithi175.stdout:212: finishing write tid 2 to smithi17529564-41 2024-04-26T02:24:29.840 INFO:tasks.rados.rados.0.smithi175.stdout:212: finishing write tid 3 to smithi17529564-41 2024-04-26T02:24:29.840 INFO:tasks.rados.rados.0.smithi175.stdout:212: finishing write tid 4 to smithi17529564-41 2024-04-26T02:24:29.840 INFO:tasks.rados.rados.0.smithi175.stdout:212: finishing write tid 5 to smithi17529564-41 2024-04-26T02:24:29.840 INFO:tasks.rados.rados.0.smithi175.stdout:212: oid 41 updating version 0 to 93 2024-04-26T02:24:29.840 INFO:tasks.rados.rados.0.smithi175.stdout:212: oid 41 version 93 is already newer than 91 2024-04-26T02:24:29.841 INFO:tasks.rados.rados.0.smithi175.stdout:212: oid 41 updating version 93 to 94 2024-04-26T02:24:29.841 INFO:tasks.rados.rados.0.smithi175.stdout:212: oid 41 version 94 is already newer than 92 2024-04-26T02:24:29.841 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 41 v 94 (ObjNum 111 snap 16 seq_num 111) dirty exists 2024-04-26T02:24:29.841 INFO:tasks.rados.rados.0.smithi175.stdout:212: left oid 41 (ObjNum 111 snap 16 seq_num 111) 2024-04-26T02:24:29.841 INFO:tasks.rados.rados.0.smithi175.stdout:208: done (2 left) 2024-04-26T02:24:29.841 INFO:tasks.rados.rados.0.smithi175.stdout:212: done (1 left) 2024-04-26T02:24:29.841 INFO:tasks.rados.rados.0.smithi175.stdout:213: done (0 left) 2024-04-26T02:24:29.842 INFO:tasks.rados.rados.0.smithi175.stdout:214: snap_create 2024-04-26T02:24:29.860 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:29.856+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:29.961 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:29.960+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:29.996 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:29.996 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:24:30.062 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:30.058+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:30.140 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:30.140 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:24:30.163 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:30.159+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:30.264 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:30.259+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:30.288 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:30.288 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.302 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:24:30.365 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:30.359+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:30.425 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:30.425 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.441 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:24:30.466 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:30.463+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:30.564 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:30.564 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.567 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:30.563+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:30.578 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:24:30.590 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:24:30.591 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.11 to 1 (10000) 2024-04-26T02:24:30.597 INFO:tasks.rados.rados.0.smithi175.stdout:214: done (0 left) 2024-04-26T02:24:30.597 INFO:tasks.rados.rados.0.smithi175.stdout:215: snap_create 2024-04-26T02:24:30.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-04-26T02:24:30.667 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:30.666+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:30.702 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:30.702 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:24:30.768 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:30.763+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:30.836 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:30.836 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.850 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:24:30.869 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:30.866+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:30.970 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:30.970 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:30.970 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:30.967+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:30.984 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:24:30.990 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:31.072 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:31.070+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:31.107 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:31.107 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:31.121 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:24:31.139 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:31.140 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:31.159 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:31.159 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:31.173 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:31.170+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:31.180 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:31.180 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:31.203 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:31.204 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:31.224 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:31.225 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:31.245 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:31.245 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:31.247 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:31.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:24:31.271 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:31.273 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:31.272+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:31.295 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:31.295 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:31.318 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:31.318 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:31.340 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:31.340 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:31.365 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:31.365 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:31.374 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:31.372+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:31.385 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:31.385 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:31.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:31.385 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.343203110000001, 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088739449999999994, 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:31.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0400000000000005e-07 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039284+0000", 2024-04-26T02:24:31.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.4362000000000004e-05 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039325+0000", 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1119999999999999e-05 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039356+0000", 2024-04-26T02:24:31.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0911999999999998e-05 2024-04-26T02:24:31.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039522+0000", 2024-04-26T02:24:31.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016579799999999999 2024-04-26T02:24:31.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039547+0000", 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4927e-05 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048026+0000", 2024-04-26T02:24:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084799690000000004 2024-04-26T02:24:31.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048083+0000", 2024-04-26T02:24:31.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6053e-05 2024-04-26T02:24:31.391 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.391 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.342999518999999, 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085876479999999998, 2024-04-26T02:24:31.392 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.393 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.393 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.393 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:31.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.394 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.394 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:31.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039413+0000", 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.037e-06 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039457+0000", 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3426000000000001e-05 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039481+0000", 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4147000000000001e-05 2024-04-26T02:24:31.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039502+0000", 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0832999999999999e-05 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039671+0000", 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000169467 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039696+0000", 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4620000000000001e-05 2024-04-26T02:24:31.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047901+0000", 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082056960000000002 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048000+0000", 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8422000000000001e-05 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.397 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.340650342, 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010661271, 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041762+0000", 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.44e-07 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041818+0000", 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6208999999999997e-05 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041850+0000", 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041876+0000", 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5426999999999999e-05 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042091+0000", 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021539399999999999 2024-04-26T02:24:31.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042116+0000", 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4403e-05 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052304+0000", 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010188236999999999 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052423+0000", 2024-04-26T02:24:31.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011882100000000001 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.340462914, 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012114710000000001, 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.402 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041950+0000", 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:31.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041995+0000", 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4988999999999999e-05 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042019+0000", 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4712999999999999e-05 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042038+0000", 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:24:31.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045071+0000", 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003033015 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045096+0000", 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4607e-05 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053959+0000", 2024-04-26T02:24:31.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088630800000000006 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054064+0000", 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104576 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 37/31 ECSubWrite(tid=33, reqid=osd.13.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.051598+0000", 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.330813516999999, 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0055111700000000001, 2024-04-26T02:24:31.406 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051598+0000", 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051598+0000", 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051599+0000", 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.127e-06 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051627+0000", 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8129000000000001e-05 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051654+0000", 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6060000000000001e-05 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051674+0000", 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0509999999999998e-05 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051882+0000", 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020844400000000001 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051905+0000", 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2685999999999999e-05 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057025+0000", 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0051194919999999998 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057109+0000", 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4722000000000006e-05 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 38/31 ECSubWrite(tid=66, reqid=osd.0.0:66, at_version=38'31, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.038525+0000", 2024-04-26T02:24:31.410 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.343886847, 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0050321640000000004, 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038525+0000", 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038525+0000", 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038526+0000", 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.37e-07 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038602+0000", 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6722000000000002e-05 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038649+0000", 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6817000000000003e-05 2024-04-26T02:24:31.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038673+0000", 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3659000000000002e-05 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038894+0000", 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000220917 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.038919+0000", 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5182999999999999e-05 2024-04-26T02:24:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043476+0000", 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004557144 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043557+0000", 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0984999999999998e-05 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.414 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.337215884999999, 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088105490000000009, 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045198+0000", 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7740000000000001e-06 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045280+0000", 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2705000000000002e-05 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045313+0000", 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2483000000000001e-05 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045335+0000", 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2316000000000001e-05 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046297+0000", 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00096208100000000005 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046319+0000", 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2238999999999998e-05 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053912+0000", 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007592639 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054006+0000", 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4312000000000001e-05 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.418 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 38/31 ECSubWrite(tid=49, reqid=osd.12.0:49, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.336970961999999, 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075694860000000003, 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045441+0000", 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9400000000000005e-07 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045486+0000", 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4542999999999997e-05 2024-04-26T02:24:31.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045512+0000", 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5649000000000001e-05 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045531+0000", 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9293e-05 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045943+0000", 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00041208100000000001 2024-04-26T02:24:31.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045966+0000", 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2952999999999999e-05 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.052897+0000", 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069310279999999997 2024-04-26T02:24:31.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053010+0000", 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011334500000000001 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.335283268000001, 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085403059999999992, 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.423 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.424 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047129+0000", 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047178+0000", 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8572999999999997e-05 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047206+0000", 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8422e-05 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047294+0000", 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8269000000000005e-05 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047694+0000", 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039957799999999999 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047729+0000", 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5002999999999997e-05 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055582+0000", 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0078527289999999993 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055669+0000", 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7025000000000001e-05 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 38/31 ECSubWrite(tid=39, reqid=osd.13.0:34, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.060097+0000", 2024-04-26T02:24:31.427 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.322314743, 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041638559999999996, 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060097+0000", 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060097+0000", 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060099+0000", 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8500000000000001e-06 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060125+0000", 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6103000000000001e-05 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060156+0000", 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1155999999999998e-05 2024-04-26T02:24:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060178+0000", 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1546999999999999e-05 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060383+0000", 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020574699999999999 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060408+0000", 2024-04-26T02:24:31.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4545999999999998e-05 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064172+0000", 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037643350000000002 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064261+0000", 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8572000000000005e-05 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 49/31 ECSubWrite(tid=96, reqid=client.4589.0:332, at_version=49'35, trim_to=0'0, roll_forward_to=38'33))", 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:16.489367+0000", 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.893044219, 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057546020000000002, 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489367+0000", 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.432 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489367+0000", 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489368+0000", 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489417+0000", 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8903000000000003e-05 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489450+0000", 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2602999999999999e-05 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489472+0000", 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2446000000000002e-05 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489681+0000", 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000209211 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.489708+0000", 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6373999999999999e-05 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.495069+0000", 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0053609219999999997 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:16.495122+0000", 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3452999999999998e-05 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.435 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 55/31 ECSubWrite(tid=117, reqid=client.4589.0:371, at_version=55'48, trim_to=0'0, roll_forward_to=51'45))", 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.492996+0000", 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.889415391, 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0044670760000000004, 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.492996+0000", 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.492996+0000", 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.492998+0000", 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.77e-06 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.493363+0000", 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036496 2024-04-26T02:24:31.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.493398+0000", 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5049000000000003e-05 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.493433+0000", 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5110000000000001e-05 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.493582+0000", 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014890199999999999 2024-04-26T02:24:31.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.493665+0000", 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2705000000000002e-05 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.497398+0000", 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037330269999999999 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.497463+0000", 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.5553000000000001e-05 2024-04-26T02:24:31.439 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.860654+0000", 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 8.5217572710000002, 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00619544, 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.440 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.860654+0000", 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.860654+0000", 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.860674+0000", 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9610999999999999e-05 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.863878+0000", 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0032035309999999999 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.863891+0000", 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3816e-05 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.863900+0000", 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0070000000000003e-06 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.863993+0000", 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2184999999999999e-05 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.864006+0000", 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3825000000000001e-05 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.866810+0000", 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028032159999999999 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.866850+0000", 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0249e-05 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 59/31 ECSubWrite(tid=77, reqid=osd.13.0:77, at_version=59'24, trim_to=0'0, roll_forward_to=58'22))", 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.559760+0000", 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.8226513749999995, 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0050534559999999996, 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.444 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.559760+0000", 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.559760+0000", 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.559761+0000", 2024-04-26T02:24:31.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.04e-06 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.559817+0000", 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5668999999999998e-05 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.559843+0000", 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5496000000000001e-05 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.559862+0000", 2024-04-26T02:24:31.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9616999999999999e-05 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.560082+0000", 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022018100000000001 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.560112+0000", 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9369e-05 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564708+0000", 2024-04-26T02:24:31.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045959679999999998 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564814+0000", 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000106116 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 59/31 ECSubWrite(tid=132, reqid=osd.12.0:132, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.566418+0000", 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.8159938929999999, 2024-04-26T02:24:31.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0067623539999999999, 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566418+0000", 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566418+0000", 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566419+0000", 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.373e-06 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566478+0000", 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8829000000000002e-05 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569489+0000", 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003011405 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569518+0000", 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8696000000000001e-05 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569689+0000", 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017094500000000001 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569715+0000", 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6177e-05 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573091+0000", 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0033758099999999999 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573180+0000", 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9118999999999998e-05 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:31.452 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.579944+0000", 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.8024681149999999, 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059048110000000003, 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579944+0000", 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579944+0000", 2024-04-26T02:24:31.453 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579946+0000", 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2170000000000001e-06 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580043+0000", 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7466000000000005e-05 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580073+0000", 2024-04-26T02:24:31.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9969999999999999e-05 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580095+0000", 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1889e-05 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580277+0000", 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018194199999999999 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580303+0000", 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5442000000000001e-05 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585768+0000", 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054653460000000003 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585848+0000", 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0538999999999996e-05 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.580164+0000", 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.8022473730000002, 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0067171610000000001, 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580164+0000", 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.457 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580164+0000", 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580165+0000", 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2999999999999999e-07 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580210+0000", 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4778999999999999e-05 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580236+0000", 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.563e-05 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580255+0000", 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9412999999999999e-05 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581237+0000", 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0009818959999999999 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581262+0000", 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5015999999999999e-05 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586795+0000", 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0055332749999999998 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586881+0000", 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6222000000000002e-05 2024-04-26T02:24:31.460 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.580327+0000", 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.8020848249999997, 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0055160269999999997, 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.461 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580327+0000", 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580327+0000", 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580328+0000", 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8299999999999995e-07 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580361+0000", 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3652999999999998e-05 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580390+0000", 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8843000000000002e-05 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580401+0000", 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1175999999999999e-05 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580559+0000", 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015805600000000001 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580585+0000", 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5386000000000001e-05 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585709+0000", 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0051240820000000003 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585843+0000", 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000133948 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.0s1 59/31 ECSubWrite(tid=38, reqid=osd.1.0:37, at_version=0'0, trim_to=0'0, roll_forward_to=59'25))", 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.588413+0000", 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.7939985050000002, 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046075140000000001, 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588413+0000", 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588413+0000", 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588415+0000", 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9829999999999999e-06 2024-04-26T02:24:31.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588444+0000", 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9243000000000001e-05 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588506+0000", 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1376000000000003e-05 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588529+0000", 2024-04-26T02:24:31.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.285e-05 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588706+0000", 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017777400000000001 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588746+0000", 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9690000000000001e-05 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.592933+0000", 2024-04-26T02:24:31.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0041871249999999999 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.593021+0000", 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7472999999999994e-05 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 60/31 ECSubWrite(tid=138, reqid=client.4589.0:507, at_version=60'54, trim_to=0'0, roll_forward_to=59'52))", 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.473920+0000", 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 3.9084916860000001, 2024-04-26T02:24:31.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052897769999999998, 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.473920+0000", 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.473920+0000", 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.470 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.473921+0000", 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5700000000000002e-07 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.474296+0000", 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037528600000000001 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.474331+0000", 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5525999999999998e-05 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.471 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.474355+0000", 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.41e-05 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.474532+0000", 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017671399999999999 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.474554+0000", 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2274000000000001e-05 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.479131+0000", 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045764170000000002 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.479210+0000", 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8903e-05 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.473 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:31.474 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:31.475 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:31.476 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:31.476 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:31.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:24:31.477 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:31.477 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:31.477 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:31.478 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:31.478 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:31.472+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:31.484 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:31.484 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:31.575 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:31.571+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:31.600 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.12 to 1 (10000) 2024-04-26T02:24:31.605 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:31.606 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:31.606 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:31.606 INFO:tasks.rados.rados.0.smithi175.stdout:215: done (0 left) 2024-04-26T02:24:31.606 INFO:tasks.rados.rados.0.smithi175.stdout:216: snap_remove snap 13 2024-04-26T02:24:31.620 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:24:31.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-04-26T02:24:31.676 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:31.674+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:31.740 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:31.740 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:31.740 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:31.740 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:31.740 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:31.754 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:31.777 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:31.776+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:31.878 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:31.874+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:31.879 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:31.879 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:31.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:31.879 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:31.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.034007+0000", 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.841929053000001, 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0076973689999999999, 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034007+0000", 2024-04-26T02:24:31.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034007+0000", 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034009+0000", 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5430000000000001e-06 2024-04-26T02:24:31.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034052+0000", 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3155999999999998e-05 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034077+0000", 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5193000000000001e-05 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.882 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034097+0000", 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9423e-05 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035378+0000", 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001280977 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.035400+0000", 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2317e-05 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041609+0000", 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062089770000000001 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041705+0000", 2024-04-26T02:24:31.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5783000000000001e-05 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.050841+0000", 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.825095288, 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0065677239999999996, 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.885 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050841+0000", 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050841+0000", 2024-04-26T02:24:31.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050843+0000", 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.567e-06 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050868+0000", 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5449999999999999e-05 2024-04-26T02:24:31.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050899+0000", 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0409e-05 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.050921+0000", 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2853e-05 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051125+0000", 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020369100000000001 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.051160+0000", 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4418999999999997e-05 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057304+0000", 2024-04-26T02:24:31.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061447400000000001 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.057409+0000", 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104595 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.890 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:203 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.842821752999999, 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017435761000000001, 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 203 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033119+0000", 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1899999999999997e-06 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033136+0000", 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7200000000000001e-05 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033176+0000", 2024-04-26T02:24:31.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9603e-05 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033196+0000", 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0492999999999998e-05 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033371+0000", 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000174864 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033394+0000", 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043073+0000", 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0096797610000000003 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043333+0000", 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000259602 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050550+0000", 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072173649999999999 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.896 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:204 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.842691130999999, 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019331481000000001, 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 204 2024-04-26T02:24:31.897 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033247+0000", 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0870000000000001e-06 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033257+0000", 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8859999999999999e-06 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033277+0000", 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0213000000000001e-05 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033292+0000", 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4503e-05 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033585+0000", 2024-04-26T02:24:31.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029350600000000002 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033603+0000", 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7706999999999998e-05 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044154+0000", 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010550888 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044306+0000", 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000152258 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.052577+0000", 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082704330000000006 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:205 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.842614108999999, 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020334097999999998, 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 205 2024-04-26T02:24:31.903 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033324+0000", 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.297e-06 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033333+0000", 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2730000000000008e-06 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033352+0000", 2024-04-26T02:24:31.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8768999999999999e-05 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033369+0000", 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7703999999999999e-05 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033691+0000", 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032162500000000003 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033707+0000", 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6135999999999999e-05 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047742+0000", 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014034835000000001 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.048005+0000", 2024-04-26T02:24:31.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026275300000000001 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053656+0000", 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056517060000000003 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:31.908 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.840928886, 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012539899, 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035010+0000", 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.967e-06 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035065+0000", 2024-04-26T02:24:31.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5315999999999997e-05 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035098+0000", 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2839000000000002e-05 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035119+0000", 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1787e-05 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035327+0000", 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020782 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035341+0000", 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3597e-05 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047462+0000", 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012120743999999999 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047547+0000", 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5828999999999994e-05 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:31.913 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.834930544999999, 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085734929999999997, 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:31.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041006+0000", 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9399999999999995e-07 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041059+0000", 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3072999999999998e-05 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041092+0000", 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2348999999999998e-05 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041115+0000", 2024-04-26T02:24:31.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3027000000000002e-05 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041355+0000", 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00024024300000000001 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041381+0000", 2024-04-26T02:24:31.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5629000000000001e-05 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.049358+0000", 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079771979999999996 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.049579+0000", 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022148 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.918 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.834338866, 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097802059999999996, 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.919 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041598+0000", 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5700000000000002e-07 2024-04-26T02:24:31.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041673+0000", 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5065e-05 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041702+0000", 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9047000000000002e-05 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.041725+0000", 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3136e-05 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042061+0000", 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033532599999999999 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042083+0000", 2024-04-26T02:24:31.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2699000000000001e-05 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051259+0000", 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091760639999999994 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.051378+0000", 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000118312 2024-04-26T02:24:31.923 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:207 3.9s0 3:998264a7:::smithi17529564-45:head [append 0~622592] snapc 4=[4] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:07.065064+0000", 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 24.810872303, 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010368989, 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:31.924 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 207 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065064+0000", 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065064+0000", 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065066+0000", 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3649999999999998e-06 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065918+0000", 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00085115799999999997 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065941+0000", 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3363999999999999e-05 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.927 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.065952+0000", 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.146e-05 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.066042+0000", 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9071000000000002e-05 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.066060+0000", 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8893999999999999e-05 2024-04-26T02:24:31.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.068303+0000", 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002242502 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.068413+0000", 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000110503 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.069819+0000", 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014055840000000001 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071529+0000", 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001709536 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.075367+0000", 2024-04-26T02:24:31.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038380699999999998 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.075433+0000", 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6482000000000005e-05 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:210 3.9s0 3:998264a7:::smithi17529564-45:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e39)", 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:07.071811+0000", 2024-04-26T02:24:31.931 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 24.804125118000002, 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00677774, 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 210 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.932 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071811+0000", 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071811+0000", 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071812+0000", 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2699999999999999e-07 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071816+0000", 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.856e-06 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071825+0000", 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8440000000000004e-06 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.071832+0000", 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2309999999999999e-06 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.074569+0000", 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002737373 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.074665+0000", 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5691000000000003e-05 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.077440+0000", 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002774824 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.077523+0000", 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2857999999999998e-05 2024-04-26T02:24:31.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:07.078589+0000", 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001066336 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:393 3.es0 3:7ba9a40e:::smithi17529564-23:head [append 0~737280] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.768978+0000", 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.1069588919999998, 2024-04-26T02:24:31.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077788010000000001, 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 393 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.768978+0000", 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.768978+0000", 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.768980+0000", 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0650000000000001e-06 2024-04-26T02:24:31.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.770037+0000", 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010571370000000001 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.770059+0000", 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2609999999999999e-05 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.940 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.770069+0000", 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6199999999999994e-06 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.770147+0000", 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8182999999999993e-05 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.770237+0000", 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0105000000000006e-05 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.771303+0000", 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010653469999999999 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.772584+0000", 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001281279 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:31.942 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.776656+0000", 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0040716479999999998 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.776756+0000", 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100807 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:394 3.es0 3:7ba9a40e:::smithi17529564-23:head [append 0~573440] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:31.943 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.773866+0000", 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.1020704079999994, 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010022942999999999, 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 394 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.944 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.773866+0000", 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.773866+0000", 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.773868+0000", 2024-04-26T02:24:31.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9800000000000001e-06 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.774447+0000", 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00057949800000000001 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.774463+0000", 2024-04-26T02:24:31.946 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5855e-05 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.774473+0000", 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4199999999999996e-06 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.774523+0000", 2024-04-26T02:24:31.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9790000000000003e-05 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.774617+0000", 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4429e-05 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775511+0000", 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000894107 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.779250+0000", 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003738613 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.783772+0000", 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045222889999999996 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.783889+0000", 2024-04-26T02:24:31.949 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000116962 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:395 3.es0 3:7ba9a40e:::smithi17529564-23:head [append 0~196608] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.775540+0000", 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.1003962489999992, 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0098264949999999993, 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.950 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 395 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775540+0000", 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.951 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775540+0000", 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775541+0000", 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9399999999999993e-07 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775813+0000", 2024-04-26T02:24:31.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000271869 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775828+0000", 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.465e-05 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775836+0000", 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3119999999999994e-06 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.776838+0000", 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001001748 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.776939+0000", 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010159500000000001 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.954 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.777779+0000", 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00083947500000000001 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.779532+0000", 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0017533869999999999 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785313+0000", 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057812439999999996 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785367+0000", 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3220999999999997e-05 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:396 3.es0 3:7ba9a40e:::smithi17529564-23:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.775854+0000", 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.1000820410000003, 2024-04-26T02:24:31.956 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.009705165, 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 396 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.957 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775854+0000", 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775854+0000", 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775855+0000", 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.026e-06 2024-04-26T02:24:31.958 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775861+0000", 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8300000000000001e-06 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775871+0000", 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6709999999999994e-06 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.959 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775878+0000", 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2089999999999999e-06 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.778286+0000", 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002407392 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.778395+0000", 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000109152 2024-04-26T02:24:31.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.778915+0000", 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00052044500000000002 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.779912+0000", 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00099661600000000008 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785474+0000", 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0055623460000000001 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785560+0000", 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5477999999999997e-05 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:397 3.es0 3:7ba9a40e:::smithi17529564-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.1000467799999996, 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013103264, 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 397 2024-04-26T02:24:31.963 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.964 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775894+0000", 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1559999999999999e-06 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775903+0000", 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9709999999999999e-06 2024-04-26T02:24:31.965 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775912+0000", 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1620000000000008e-06 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.779401+0000", 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00348957 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.966 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.779492+0000", 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0451000000000005e-05 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785914+0000", 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0064220199999999996 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785992+0000", 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8082000000000002e-05 2024-04-26T02:24:31.967 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.788993+0000", 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0030011320000000001 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.566150+0000", 2024-04-26T02:24:31.968 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.3097864399999999, 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082019950000000001, 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566150+0000", 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566150+0000", 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566151+0000", 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2299999999999999e-07 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.970 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566201+0000", 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9685999999999998e-05 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566232+0000", 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.095e-05 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.971 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566255+0000", 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3408999999999999e-05 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566416+0000", 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016105899999999999 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566442+0000", 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6245999999999999e-05 2024-04-26T02:24:31.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.574272+0000", 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0078293860000000007 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.574352+0000", 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0335999999999998e-05 2024-04-26T02:24:31.973 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.567347+0000", 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.3085890100000004, 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086281380000000005, 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.974 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567347+0000", 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567347+0000", 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.975 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567348+0000", 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8299999999999995e-07 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567400+0000", 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1842999999999998e-05 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567424+0000", 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.368e-05 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567443+0000", 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8783e-05 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567756+0000", 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031286999999999998 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567779+0000", 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3509000000000001e-05 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575844+0000", 2024-04-26T02:24:31.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080648339999999999 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575976+0000", 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000131636 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:31.979 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.571312+0000", 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.3046242790000004, 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085738749999999999, 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571312+0000", 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.980 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571312+0000", 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571314+0000", 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.59e-06 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571366+0000", 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2716000000000001e-05 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571399+0000", 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2552999999999998e-05 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571421+0000", 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2059e-05 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571623+0000", 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020218800000000001 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571649+0000", 2024-04-26T02:24:31.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5287e-05 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579788+0000", 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0081397559999999997 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579886+0000", 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7726000000000006e-05 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.984 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 59/31 ECSubWrite(tid=169, reqid=osd.0.0:169, at_version=59'47, trim_to=0'0, roll_forward_to=59'45))", 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.586854+0000", 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.289082176, 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0070915659999999997, 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.985 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586854+0000", 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586854+0000", 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586856+0000", 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9199999999999998e-06 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586911+0000", 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4790000000000002e-05 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586944+0000", 2024-04-26T02:24:31.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2605999999999999e-05 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.586968+0000", 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4113000000000001e-05 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587172+0000", 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020413199999999999 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587198+0000", 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5936e-05 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.593860+0000", 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066620439999999998 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.989 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.593946+0000", 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6025000000000004e-05 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 59/31 ECSubWrite(tid=136, reqid=osd.12.0:135, at_version=0'0, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.587186+0000", 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.2887499360000003, 2024-04-26T02:24:31.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068349040000000002, 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587186+0000", 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:31.991 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587186+0000", 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587188+0000", 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0499999999999999e-06 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:31.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587208+0000", 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0832999999999999e-05 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587248+0000", 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.998e-05 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587270+0000", 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1327000000000001e-05 2024-04-26T02:24:31.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587642+0000", 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037272899999999997 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.587669+0000", 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6288999999999999e-05 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.593920+0000", 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062517739999999999 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.594021+0000", 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010092199999999999 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:31.995 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:31.997 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:31.998 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:31.996+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:32.098 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:32.094+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:32.124 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:32.124 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:32.124 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:32.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:32.199 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:32.194+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:32.261 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:32.261 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:32.261 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:32.261 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:32.261 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:32.277 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:32.326 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:32.323+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:32.401 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:32.398+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.365798804000001, 2024-04-26T02:24:32.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075357569999999997, 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:32.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033385+0000", 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4e-07 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033444+0000", 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9450999999999997e-05 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033476+0000", 2024-04-26T02:24:32.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1979e-05 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033497+0000", 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0616999999999999e-05 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033684+0000", 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018750700000000001 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033709+0000", 2024-04-26T02:24:32.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4912000000000001e-05 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040833+0000", 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071240510000000002 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040919+0000", 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6399999999999999e-05 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.364900103, 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010955845000000001, 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034285+0000", 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8669999999999998e-06 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034349+0000", 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4090999999999993e-05 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034386+0000", 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6511999999999999e-05 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034409+0000", 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3198999999999999e-05 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035470+0000", 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001061195 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035486+0000", 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5699999999999999e-05 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045121+0000", 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096354679999999995 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045238+0000", 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011681299999999999 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.360508122999999, 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077721719999999999, 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038675+0000", 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038732+0000", 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024999999999997e-05 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038765+0000", 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2325e-05 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038789+0000", 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4905999999999998e-05 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039037+0000", 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024744900000000001 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039062+0000", 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4719000000000002e-05 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046357+0000", 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072952980000000004 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046447+0000", 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9690000000000004e-05 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.351198351000001, 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063472160000000001, 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.415 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047986+0000", 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9199999999999998e-06 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048038+0000", 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2228000000000002e-05 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048069+0000", 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0719000000000002e-05 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048096+0000", 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6458999999999999e-05 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048471+0000", 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037564800000000002 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048496+0000", 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4786e-05 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054242+0000", 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057465149999999998 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054331+0000", 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8941000000000001e-05 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.419 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.347967077, 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067178699999999999, 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:32.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051217+0000", 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0099999999999998e-06 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051246+0000", 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8345999999999999e-05 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051275+0000", 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8921999999999999e-05 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051313+0000", 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7991999999999998e-05 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051640+0000", 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032731600000000002 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051665+0000", 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4729e-05 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057825+0000", 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061603889999999996 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057933+0000", 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010816599999999999 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.424 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=29, reqid=osd.8.0:28, at_version=0'0, trim_to=0'0, roll_forward_to=37'22))", 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.055636+0000", 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.343546698000001, 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0051422209999999998, 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055636+0000", 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055636+0000", 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055638+0000", 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6929999999999999e-06 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055662+0000", 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.478e-05 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055710+0000", 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7413999999999997e-05 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055733+0000", 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3476e-05 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055920+0000", 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018722699999999999 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.055945+0000", 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4253e-05 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.060680+0000", 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047349549999999999 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.060778+0000", 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8423000000000003e-05 2024-04-26T02:24:32.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.364033971000001, 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018386527999999999, 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035150+0000", 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9230000000000001e-06 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035236+0000", 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5860999999999997e-05 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035280+0000", 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3810999999999998e-05 2024-04-26T02:24:32.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035303+0000", 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3223000000000001e-05 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035450+0000", 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014687200000000001 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035475+0000", 2024-04-26T02:24:32.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4623000000000001e-05 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053426+0000", 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017950875000000002 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053535+0000", 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010933999999999999 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.357355869999999, 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012671968, 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041874+0000", 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6728999999999999e-05 2024-04-26T02:24:32.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041914+0000", 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0312000000000003e-05 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041939+0000", 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4116000000000001e-05 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042110+0000", 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000171094 2024-04-26T02:24:32.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042135+0000", 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.493e-05 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054408+0000", 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012273386000000001 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054499+0000", 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0650999999999997e-05 2024-04-26T02:24:32.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.352750478000001, 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082587159999999993, 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046434+0000", 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.193e-06 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046463+0000", 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046509+0000", 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6078000000000002e-05 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046565+0000", 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6048999999999998e-05 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046730+0000", 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165408 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046747+0000", 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6353000000000001e-05 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054637+0000", 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078899409999999993 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054691+0000", 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4200999999999998e-05 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 42/31 ECSubWrite(tid=44, reqid=client.4589.0:255, at_version=0'0, trim_to=0'0, roll_forward_to=42'36))", 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:10.080640+0000", 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.31854302, 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058679439999999999, 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.442 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080640+0000", 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080640+0000", 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080641+0000", 2024-04-26T02:24:32.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.46e-06 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080659+0000", 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8468999999999999e-05 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080684+0000", 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4196e-05 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080699+0000", 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5322999999999999e-05 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080814+0000", 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011492 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.080831+0000", 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7252999999999999e-05 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.086415+0000", 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055835989999999999 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:10.086507+0000", 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2724000000000002e-05 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 48/31 ECSubWrite(tid=92, reqid=client.4589.0:325, at_version=48'23, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:32.446 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.490261+0000", 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 16.908921555999999, 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060390089999999997, 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490261+0000", 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490261+0000", 2024-04-26T02:24:32.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490263+0000", 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8840000000000001e-06 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490311+0000", 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7972000000000001e-05 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490342+0000", 2024-04-26T02:24:32.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1408999999999997e-05 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490365+0000", 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2583e-05 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491111+0000", 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00074644399999999997 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491127+0000", 2024-04-26T02:24:32.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5852999999999999e-05 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496176+0000", 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0050483730000000001 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496300+0000", 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012449100000000001 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 59/31 ECSubWrite(tid=68, reqid=osd.15.0:68, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.557535+0000", 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8416472529999997, 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063276529999999999, 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557535+0000", 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557535+0000", 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557536+0000", 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557592+0000", 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5732000000000001e-05 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557635+0000", 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3118999999999998e-05 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557662+0000", 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7287000000000001e-05 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557848+0000", 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000185949 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557876+0000", 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7823000000000001e-05 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563763+0000", 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058871339999999996 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563863+0000", 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9821999999999994e-05 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.454 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8401991730000002, 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014202093000000001, 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:24:32.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558985+0000", 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.807e-06 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559023+0000", 2024-04-26T02:24:32.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7985999999999998e-05 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559047+0000", 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4032999999999998e-05 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559062+0000", 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5082999999999999e-05 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559703+0000", 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064080699999999997 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559728+0000", 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4851999999999999e-05 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573054+0000", 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013325590999999999 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573185+0000", 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131934 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8386649540000004, 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079052459999999995, 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.459 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:32.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560592+0000", 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4134999999999994e-05 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560624+0000", 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1325999999999998e-05 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560647+0000", 2024-04-26T02:24:32.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560875+0000", 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022790500000000001 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560900+0000", 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5420000000000001e-05 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568320+0000", 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074198320000000003 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568423+0000", 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102675 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8315327049999999, 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084963339999999995, 2024-04-26T02:24:32.463 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567651+0000", 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567703+0000", 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2142000000000003e-05 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567774+0000", 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1445000000000005e-05 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567813+0000", 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9026000000000002e-05 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568266+0000", 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045321000000000001 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568294+0000", 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.743e-05 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576057+0000", 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077626329999999997 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576146+0000", 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9648000000000006e-05 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:32.467 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8313101070000002, 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014301641, 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:24:32.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567874+0000", 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.19e-06 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567930+0000", 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6505999999999997e-05 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567966+0000", 2024-04-26T02:24:32.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5441999999999997e-05 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567986+0000", 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0086999999999999e-05 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569871+0000", 2024-04-26T02:24:32.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001885751 2024-04-26T02:24:32.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569896+0000", 2024-04-26T02:24:32.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4369e-05 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582080+0000", 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012184133999999999 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582174+0000", 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4161999999999997e-05 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.573867+0000", 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8253157810000005, 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064014639999999999, 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573867+0000", 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573867+0000", 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573869+0000", 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9199999999999998e-06 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573894+0000", 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5692999999999999e-05 2024-04-26T02:24:32.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573929+0000", 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4566000000000001e-05 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573953+0000", 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3569000000000001e-05 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574373+0000", 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042068900000000002 2024-04-26T02:24:32.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574401+0000", 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8279000000000001e-05 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580205+0000", 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058032329999999997 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580268+0000", 2024-04-26T02:24:32.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3515000000000004e-05 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 59/31 ECSubWrite(tid=37, reqid=osd.1.0:37, at_version=59'25, trim_to=0'0, roll_forward_to=51'23))", 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.574061+0000", 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8251216650000002, 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061051940000000004, 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574061+0000", 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574061+0000", 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574061+0000", 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9299999999999998e-07 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574116+0000", 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5033e-05 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574143+0000", 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7016e-05 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574166+0000", 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2169000000000001e-05 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574352+0000", 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018684300000000001 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574376+0000", 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3989999999999999e-05 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580072+0000", 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056956619999999998 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580166+0000", 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3987999999999995e-05 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=169, reqid=osd.0.0:169, at_version=59'47, trim_to=0'0, roll_forward_to=59'45))", 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.587151+0000", 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8120311789999999, 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006023881, 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.483 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587151+0000", 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587151+0000", 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587153+0000", 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8929999999999999e-06 2024-04-26T02:24:32.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587212+0000", 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8606000000000001e-05 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587256+0000", 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4279000000000001e-05 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587280+0000", 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3776000000000001e-05 2024-04-26T02:24:32.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587513+0000", 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023342799999999999 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587540+0000", 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6173000000000002e-05 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.593084+0000", 2024-04-26T02:24:32.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055440419999999999 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.593175+0000", 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1683999999999998e-05 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 59/31 ECSubWrite(tid=38, reqid=osd.1.0:37, at_version=0'0, trim_to=0'0, roll_forward_to=59'25))", 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.588336+0000", 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.8108467240000001, 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064016409999999996, 2024-04-26T02:24:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588336+0000", 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588336+0000", 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588338+0000", 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5069999999999999e-06 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588368+0000", 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9873e-05 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588403+0000", 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4405e-05 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588427+0000", 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4409999999999998e-05 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588574+0000", 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147377 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588599+0000", 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4243000000000002e-05 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.594636+0000", 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060372280000000004 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.594737+0000", 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101598 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.491 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:32.492 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:32.492 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:32.492 INFO:tasks.rados.rados.0.smithi175.stdout:216: done (0 left) 2024-04-26T02:24:32.493 INFO:tasks.rados.rados.0.smithi175.stdout:217: snap_remove snap 11 2024-04-26T02:24:32.493 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.13 to 1 (10000) 2024-04-26T02:24:32.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:32.498 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-04-26T02:24:32.502 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:32.496+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:32.603 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:32.599+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:32.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T02:24:32.662 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:32.662 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:32.663 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:32.663 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:32.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:32.704 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:32.700+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:32.805 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:32.799+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:32.841 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:32.841 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:32.841 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:32.856 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:32.906 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:32.904+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:33.008 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:33.006+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:33.019 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:33.019 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:33.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:33.019 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.096404509000003, 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.073984011000000002, 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:33.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918606+0000", 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.396e-06 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918620+0000", 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:24:33.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918641+0000", 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0389000000000001e-05 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918657+0000", 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6671999999999999e-05 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918805+0000", 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014724900000000001 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918819+0000", 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4453e-05 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.988816+0000", 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069997045999999993 2024-04-26T02:24:33.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989070+0000", 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025383399999999998 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989371+0000", 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030080500000000002 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.990597+0000", 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012262740000000001 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992421+0000", 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001824132 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992517+0000", 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5880999999999999e-05 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992587+0000", 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0359999999999997e-05 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.027 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.85980138, 2024-04-26T02:24:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017497523000000001, 2024-04-26T02:24:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.028 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 87 2024-04-26T02:24:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3300000000000001e-07 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155289+0000", 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1913e-05 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155300+0000", 2024-04-26T02:24:33.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1202e-05 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155308+0000", 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000001e-06 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160230+0000", 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049217719999999996 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160358+0000", 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012813700000000001 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160555+0000", 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197207 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163938+0000", 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003382945 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172543+0000", 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086049179999999996 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172636+0000", 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2918999999999996e-05 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172704+0000", 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8007000000000001e-05 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.035 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.859687102999999, 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017505889, 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 88 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.036 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155322+0000", 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155328+0000", 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2700000000000001e-06 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155358+0000", 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0624999999999999e-05 2024-04-26T02:24:33.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155373+0000", 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4229999999999999e-05 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.162973+0000", 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076001050000000002 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163128+0000", 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015489200000000001 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163377+0000", 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024957100000000003 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.165420+0000", 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020422349999999999 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172717+0000", 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072976839999999996 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172781+0000", 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3910000000000003e-05 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172827+0000", 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5587000000000002e-05 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.688301008000003, 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018318649999999999, 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.042 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 114 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:33.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326708+0000", 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9700000000000005e-07 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326713+0000", 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326722+0000", 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9199999999999993e-06 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326729+0000", 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1489999999999997e-06 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339956+0000", 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013227153 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340087+0000", 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130946 2024-04-26T02:24:33.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340294+0000", 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206434 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344052+0000", 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037581490000000001 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344900+0000", 2024-04-26T02:24:33.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084779500000000004 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344967+0000", 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607000000000005e-05 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345026+0000", 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8146999999999997e-05 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.048 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.688268125999997, 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019222108000000002, 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.049 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 115 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:33.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0399999999999995e-07 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326874+0000", 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013342599999999999 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326885+0000", 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1323e-05 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326893+0000", 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7659999999999998e-06 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342112+0000", 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015218537000000001 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342342+0000", 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023057199999999999 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342691+0000", 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034918900000000002 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345831+0000", 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031394740000000002 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345848+0000", 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7686e-05 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345912+0000", 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3709999999999998e-05 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345962+0000", 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9721e-05 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.688097454999998, 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019714167000000001, 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 116 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.056 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326911+0000", 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326924+0000", 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2743e-05 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326934+0000", 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5459999999999997e-06 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326941+0000", 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1470000000000004e-06 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344124+0000", 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017183085000000001 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344238+0000", 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114591 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344425+0000", 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018710800000000001 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345974+0000", 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001548979 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346498+0000", 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052335399999999996 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346570+0000", 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1983000000000005e-05 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346625+0000", 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4843999999999999e-05 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.062 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.688055462999998, 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020133699000000001, 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 117 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326953+0000", 2024-04-26T02:24:33.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326959+0000", 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.823e-06 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326968+0000", 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9530000000000005e-06 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326979+0000", 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1289e-05 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345091+0000", 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018111505999999999 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345217+0000", 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012587399999999999 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345409+0000", 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019226700000000001 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346352+0000", 2024-04-26T02:24:33.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00094280000000000004 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346964+0000", 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061192899999999999 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347036+0000", 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2120999999999996e-05 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347086+0000", 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0377000000000002e-05 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.523330776000002, 2024-04-26T02:24:33.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018319485, 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 139 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491678+0000", 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.333e-06 2024-04-26T02:24:33.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491688+0000", 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9299999999999998e-06 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491707+0000", 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8281999999999999e-05 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491720+0000", 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3502e-05 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504966+0000", 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013245808 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505190+0000", 2024-04-26T02:24:33.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000223876 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505520+0000", 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032999 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508527+0000", 2024-04-26T02:24:33.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030072739999999999 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509751+0000", 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012241719999999999 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509880+0000", 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128687 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509997+0000", 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116631 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.523267599999997, 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018559454, 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 140 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:33.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491742+0000", 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.404e-06 2024-04-26T02:24:33.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491946+0000", 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204086 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491967+0000", 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1049000000000001e-05 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491983+0000", 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6356000000000001e-05 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507052+0000", 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015069173 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507208+0000", 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000155783 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507411+0000", 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020306 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510024+0000", 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026129 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510123+0000", 2024-04-26T02:24:33.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8667999999999998e-05 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510230+0000", 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107565 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510300+0000", 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9410000000000001e-05 2024-04-26T02:24:33.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.522996575999997, 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018767703, 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.083 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 141 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:33.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492013+0000", 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492039+0000", 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5952000000000002e-05 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492058+0000", 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9215000000000002e-05 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492082+0000", 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4379000000000002e-05 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508623+0000", 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016540947 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508846+0000", 2024-04-26T02:24:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022293599999999999 2024-04-26T02:24:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509201+0000", 2024-04-26T02:24:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035443900000000001 2024-04-26T02:24:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510580+0000", 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013797379999999999 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510627+0000", 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6254000000000001e-05 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510715+0000", 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8215999999999997e-05 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510779+0000", 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4136999999999999e-05 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.212144645000002, 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018162602999999999, 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 186 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.092 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802865+0000", 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.666e-06 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802876+0000", 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1246e-05 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802898+0000", 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1645999999999999e-05 2024-04-26T02:24:33.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802923+0000", 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5389e-05 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.815977+0000", 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013053301 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816115+0000", 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138553 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816319+0000", 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204236 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820746+0000", 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044270739999999996 2024-04-26T02:24:33.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820868+0000", 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122127 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820949+0000", 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0395999999999994e-05 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821026+0000", 2024-04-26T02:24:33.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6969000000000001e-05 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.212059216, 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018225614000000001, 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.098 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 187 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802950+0000", 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802963+0000", 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3206e-05 2024-04-26T02:24:33.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802982+0000", 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8519e-05 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803002+0000", 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0162000000000001e-05 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816937+0000", 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013934867 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817068+0000", 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130734 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.102 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817285+0000", 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000217209 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820849+0000", 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035643160000000001 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821038+0000", 2024-04-26T02:24:33.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000188767 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821122+0000", 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4243e-05 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821174+0000", 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2181000000000001e-05 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.211962993999997, 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018460061999999999, 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.105 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 188 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803046+0000", 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4500000000000001e-06 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803180+0000", 2024-04-26T02:24:33.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013367300000000001 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803201+0000", 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1399e-05 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803217+0000", 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5556000000000001e-05 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818151+0000", 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014934374 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818319+0000", 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016765500000000001 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818541+0000", 2024-04-26T02:24:33.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022229899999999999 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821196+0000", 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002654965 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821379+0000", 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018284400000000001 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821453+0000", 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3546000000000004e-05 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821505+0000", 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2301e-05 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 44.211763108, 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018840794000000001, 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2024-04-26T02:24:33.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803246+0000", 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803257+0000", 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0825999999999999e-05 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803275+0000", 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8099999999999999e-05 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803288+0000", 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2595999999999999e-05 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819675+0000", 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016387184999999999 2024-04-26T02:24:33.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819800+0000", 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012490999999999999 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820077+0000", 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000277533 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821271+0000", 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193401 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821965+0000", 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069420199999999999 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822036+0000", 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1119999999999997e-05 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822086+0000", 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9400999999999997e-05 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:327 3.8s0 3:1859e9b5:::smithi17529564-39:head [create,setxattr `sjUtrS\\bejkdS^PZ^UbhfeR]sl^p__anSUR_aom (1578) in=40b,setxattr Xgg (981) in=3b,setxattr jjU_`S[ao\\\\^aUS`bZo^cefhdeaegSZfc]sS[m[k (631) in=40b,setxattr WptVXs^]ZljihqWVjRTTRsYbpoOd[kede^[d^iNS (15648) in=40b,setxattr NUPa_VdcRWiTY (981) in=13b,setxattr oapqrhbaXndiek^ec[NZPnlNjeX^`^^ht`__ll[g (630) in=40b,setxattr hUokalb_dNqZaP[SZdSptRb]ZndqQTkPSdWpXlg_ (1683) in=40b,setxattr SOaUaOtoOmejUfsqfadVc_\\fpWak\\^nknRQfaXOZ (9120) in=40b,setxattr r[RO_Pl (981) in=7b,setxattr OOd^ZXYi[]NO^mlSkQafkPlVaY`UYcd\\bnaQUZjq (1225) in=40b,setxattr mlY]_qqgYNhaYetZtkgQPN^a^VmW[amS`Qbadgjr (137) in=40b,setxattr iVYdjchT[j\\[\\\\Uto`qnjUcXas^PtqZa^VoRktTT (1823) in=40b,setxattr PhV`]ZkggalnUas (981) in=15b,setxattr [TNbUtYOkT`ZatPerOQOlk\\WahmgadNWaeRZ^YT\\ (1121) in=40b,setxattr aRqq]f]b_cobaZ`ZZRaattjja[X``PaT\\l\\^Y[jU (313) in=40b,setxattr qYXjVRWg (981) in=8b,setxattr cm`nfp^lmRcSZUsStaOg_omiONqeTRWUsOjm]png (1227) in=40b,setxattr _jtbmRhQeZe]nY\\TQctPVagWm[isibp]ooW`hq[Z (1367) in=40b,setxattr _Ybhal\\]RPkmpUPPRRb[_[YfQpj[aXsgkfNbeeOZ (946) in=40b,setxattr YeQo_aSrmVSirmpTkkZqfZaaqOtg\\X\\qoRPrjPai (1786) in=40b] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.529405543999999, 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019121231999999998, 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 327 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485606+0000", 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9339999999999999e-06 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485768+0000", 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162189 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485811+0000", 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2292000000000001e-05 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485835+0000", 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4182999999999999e-05 2024-04-26T02:24:33.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485963+0000", 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128157 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485976+0000", 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2571999999999999e-05 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490733+0000", 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047575610000000004 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491054+0000", 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032119599999999999 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493981+0000", 2024-04-26T02:24:33.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002926484 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503531+0000", 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009550088 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503808+0000", 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027720000000000002 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.504724+0000", 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091537599999999997 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:364 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.552973056000001, 2024-04-26T02:24:33.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019186933, 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 364 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462038+0000", 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6800000000000002e-06 2024-04-26T02:24:33.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462048+0000", 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0835999999999999e-05 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462072+0000", 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3693000000000002e-05 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462089+0000", 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6586e-05 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462283+0000", 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000194496 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462306+0000", 2024-04-26T02:24:33.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2476e-05 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471461+0000", 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091555809999999994 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471729+0000", 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026759800000000002 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.481222+0000", 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094929869999999996 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:365 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.552886450999999, 2024-04-26T02:24:33.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021296017, 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 365 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462123+0000", 2024-04-26T02:24:33.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.39e-06 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462153+0000", 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9685000000000001e-05 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462165+0000", 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2964e-05 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462181+0000", 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5778999999999999e-05 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462501+0000", 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031995299999999999 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:33.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462521+0000", 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9715999999999999e-05 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473587+0000", 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01106558 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473802+0000", 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215899 2024-04-26T02:24:33.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.483417+0000", 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096150509999999995 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:366 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:33.138 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.55278787, 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022939240999999999, 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 366 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:33.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462221+0000", 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462229+0000", 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4560000000000003e-06 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462246+0000", 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7116e-05 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462259+0000", 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3526999999999999e-05 2024-04-26T02:24:33.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462633+0000", 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037355199999999998 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462652+0000", 2024-04-26T02:24:33.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9165999999999999e-05 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478081+0000", 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015429238 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478329+0000", 2024-04-26T02:24:33.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024798499999999999 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.485159+0000", 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068299909999999997 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:508 3.8s0 3:1cc02c30:::smithi17529564-2:head [append 0~606208] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:33.144 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5426033009999998, 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018229054000000001, 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 508 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472408+0000", 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0800000000000002e-06 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473853+0000", 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014451850000000001 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473888+0000", 2024-04-26T02:24:33.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4891999999999997e-05 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473913+0000", 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5123e-05 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474093+0000", 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018053700000000001 2024-04-26T02:24:33.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474110+0000", 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6540000000000001e-05 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479082+0000", 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049724280000000001 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479346+0000", 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026396500000000001 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.482004+0000", 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026579569999999999 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.489855+0000", 2024-04-26T02:24:33.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078503649999999998 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490489+0000", 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063439499999999995 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490634+0000", 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144587 2024-04-26T02:24:33.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:512 3.8s0 3:1cc02c30:::smithi17529564-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.5294476870000002, 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017479077999999999, 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:33.152 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 512 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485562+0000", 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3e-06 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485569+0000", 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3830000000000003e-06 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485622+0000", 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3565e-05 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485640+0000", 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7416999999999999e-05 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.497174+0000", 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011534342 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.497333+0000", 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015877 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.500226+0000", 2024-04-26T02:24:33.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002893446 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.500351+0000", 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012475499999999999 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.503039+0000", 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026881000000000001 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.157 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.158 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:33.160 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:33.160 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:33.160+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:33.260 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:33.256+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:33.289 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:33.289 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:33.289 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:33.289 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:33.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:33.361 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:33.360+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:33.419 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:33.419 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:33.419 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:33.420 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:33.420 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:33.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.14 to 1 (10000) 2024-04-26T02:24:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-04-26T02:24:33.468 INFO:tasks.rados.rados.0.smithi175.stdout:217: done (0 left) 2024-04-26T02:24:33.468 INFO:tasks.rados.rados.0.smithi175.stdout:218: snap_create 2024-04-26T02:24:33.483 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:33.479+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:33.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:33.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-04-26T02:24:33.562 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:33.556+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:33.568 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.568 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 37/31 ECSubWrite(tid=45, reqid=osd.12.0:44, at_version=0'0, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.038585+0000", 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.52698277, 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066892280000000002, 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038585+0000", 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038585+0000", 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038587+0000", 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1330000000000002e-06 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038615+0000", 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8065999999999999e-05 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038655+0000", 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9987999999999997e-05 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038676+0000", 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1115999999999999e-05 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038845+0000", 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016862800000000001 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038872+0000", 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7353000000000001e-05 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045160+0000", 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062877039999999999 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045274+0000", 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011424 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.572 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.526213572, 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082822989999999999, 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:24:33.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039355+0000", 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3300000000000001e-07 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039418+0000", 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2694999999999995e-05 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039447+0000", 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9442e-05 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039470+0000", 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039659+0000", 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018914299999999999 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039683+0000", 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3915999999999999e-05 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047533+0000", 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078494710000000002 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.576 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047636+0000", 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103566 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.524038020999999, 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011160114, 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.577 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:33.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4000000000000002e-07 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041580+0000", 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9351999999999998e-05 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041619+0000", 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9152000000000001e-05 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041643+0000", 2024-04-26T02:24:33.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.421e-05 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041841+0000", 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197784 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041867+0000", 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5939e-05 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052596+0000", 2024-04-26T02:24:33.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01072906 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052690+0000", 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4077000000000001e-05 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 38/31 ECSubWrite(tid=180, reqid=osd.6.0:180, at_version=38'17, trim_to=0'0, roll_forward_to=37'15))", 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.048695+0000", 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.516872340999999, 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070111649999999998, 2024-04-26T02:24:33.581 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.048695+0000", 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.048695+0000", 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.048696+0000", 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7299999999999995e-07 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.048775+0000", 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8877999999999999e-05 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.048808+0000", 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3158999999999999e-05 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.048831+0000", 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3013000000000001e-05 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.049051+0000", 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021962899999999999 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.049076+0000", 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5469999999999998e-05 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.055603+0000", 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065268790000000002 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.055706+0000", 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103464 2024-04-26T02:24:33.585 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.058393+0000", 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.507174335999999, 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077390269999999999, 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058393+0000", 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058393+0000", 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058395+0000", 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.897e-06 2024-04-26T02:24:33.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058425+0000", 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9719000000000001e-05 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058459+0000", 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3921999999999998e-05 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058482+0000", 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2926e-05 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058644+0000", 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162428 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.058668+0000", 2024-04-26T02:24:33.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3314000000000001e-05 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.066052+0000", 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073845229999999996 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.066132+0000", 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0297999999999996e-05 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 48/31 ECSubWrite(tid=185, reqid=client.4589.0:327, at_version=48'19, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.494621+0000", 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 18.070946358, 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058382970000000001, 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.494621+0000", 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.494621+0000", 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.494622+0000", 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7999999999999996e-07 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.494700+0000", 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8314999999999998e-05 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.494734+0000", 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3658999999999997e-05 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.494757+0000", 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2935999999999999e-05 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495228+0000", 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00047146800000000001 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495264+0000", 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5355999999999998e-05 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500358+0000", 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005094899 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.500460+0000", 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101184 2024-04-26T02:24:33.594 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.706099050000001, 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083055990000000003, 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8700000000000001e-07 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.596 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862768+0000", 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003299438 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862799+0000", 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0465999999999999e-05 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862815+0000", 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6118999999999999e-05 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862957+0000", 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014188100000000001 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862972+0000", 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5512999999999999e-05 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867700+0000", 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00472735 2024-04-26T02:24:33.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867774+0000", 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4444999999999996e-05 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs2 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.0041826690000004, 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093447500000000006, 2024-04-26T02:24:33.599 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561386+0000", 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8999999999999996e-07 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561441+0000", 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5689000000000002e-05 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561502+0000", 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0788000000000001e-05 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561527+0000", 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4479999999999999e-05 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561735+0000", 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020879899999999999 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561760+0000", 2024-04-26T02:24:33.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5003000000000001e-05 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570592+0000", 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088311770000000008 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570730+0000", 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138224 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.603 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.9995133620000001, 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013994609999999999, 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566055+0000", 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566133+0000", 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7651999999999994e-05 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566166+0000", 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3189999999999999e-05 2024-04-26T02:24:33.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566189+0000", 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3315e-05 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566604+0000", 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041534500000000002 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566631+0000", 2024-04-26T02:24:33.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6792999999999999e-05 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579960+0000", 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013328751 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580049+0000", 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8918000000000005e-05 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.997440192, 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015943736999999999, 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568128+0000", 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3e-07 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568181+0000", 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2899000000000003e-05 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568212+0000", 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0596000000000003e-05 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568238+0000", 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6169999999999998e-05 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568483+0000", 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000245121 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568508+0000", 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5593e-05 2024-04-26T02:24:33.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.583979+0000", 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015470133 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584071+0000", 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2595000000000004e-05 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.9947954269999997, 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013783561999999999, 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570774+0000", 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6029999999999999e-06 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570834+0000", 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0248999999999999e-05 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.615 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570863+0000", 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8473e-05 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570927+0000", 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4335e-05 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571242+0000", 2024-04-26T02:24:33.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000315144 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571308+0000", 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5808000000000004e-05 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584459+0000", 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013150818 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584556+0000", 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7132000000000004e-05 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.9915133279999999, 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011186935, 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.618 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574055+0000", 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:24:33.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574110+0000", 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4701999999999999e-05 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574134+0000", 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4672999999999999e-05 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574153+0000", 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8372999999999998e-05 2024-04-26T02:24:33.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576753+0000", 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026005830000000001 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576778+0000", 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4793000000000001e-05 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585168+0000", 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083896360000000007 2024-04-26T02:24:33.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585241+0000", 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3515000000000003e-05 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.9898209700000002, 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084735320000000006, 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575749+0000", 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8700000000000001e-06 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575775+0000", 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6783000000000001e-05 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575804+0000", 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8296000000000001e-05 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575826+0000", 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1970000000000001e-05 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576058+0000", 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023252799999999999 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576084+0000", 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5469e-05 2024-04-26T02:24:33.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584119+0000", 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080353009999999999 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584220+0000", 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101315 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.626 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.577312+0000", 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.988255519, 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076345989999999997, 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577312+0000", 2024-04-26T02:24:33.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577312+0000", 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577314+0000", 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0140000000000001e-06 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577368+0000", 2024-04-26T02:24:33.628 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3594999999999998e-05 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577400+0000", 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2298999999999997e-05 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577422+0000", 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2120000000000002e-05 2024-04-26T02:24:33.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577613+0000", 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000190636 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.577679+0000", 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6464999999999995e-05 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584882+0000", 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072023240000000004 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584947+0000", 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5146000000000003e-05 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.986707987, 2024-04-26T02:24:33.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010250464000000001, 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578862+0000", 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.136e-06 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578953+0000", 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1671999999999999e-05 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578986+0000", 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2431999999999997e-05 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579009+0000", 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2997e-05 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580832+0000", 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018229279999999999 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580857+0000", 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5069999999999999e-05 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589005+0000", 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081481079999999994 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589110+0000", 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105121 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.635 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s5 59/31 ECSubWrite(tid=24, reqid=osd.3.0:24, at_version=59'22, trim_to=0'0, roll_forward_to=58'20))", 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.584717+0000", 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.980851146, 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066441629999999998, 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584717+0000", 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584717+0000", 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584717+0000", 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5700000000000002e-07 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584765+0000", 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8028999999999997e-05 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584794+0000", 2024-04-26T02:24:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8753000000000001e-05 2024-04-26T02:24:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584816+0000", 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2172999999999999e-05 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585075+0000", 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000258948 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585098+0000", 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3482999999999999e-05 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.591260+0000", 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061619420000000001 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.591361+0000", 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100278 2024-04-26T02:24:33.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 59/31 ECSubWrite(tid=46, reqid=osd.11.0:46, at_version=59'34, trim_to=0'0, roll_forward_to=58'32))", 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.587126+0000", 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.9784421190000003, 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065883670000000004, 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587126+0000", 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587126+0000", 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587127+0000", 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.894e-06 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587190+0000", 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2650999999999994e-05 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587228+0000", 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7642999999999999e-05 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587254+0000", 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.588e-05 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587916+0000", 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00066203900000000001 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587941+0000", 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5147000000000002e-05 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.593616+0000", 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005675668 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.593714+0000", 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7445e-05 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.646 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=136, reqid=osd.12.0:135, at_version=0'0, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.587240+0000", 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 6.9783275610000004, 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063133089999999996, 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.647 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587240+0000", 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587240+0000", 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587241+0000", 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3260000000000001e-06 2024-04-26T02:24:33.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587263+0000", 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1787e-05 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587288+0000", 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4399000000000001e-05 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587308+0000", 2024-04-26T02:24:33.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0037000000000001e-05 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587558+0000", 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025017099999999999 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.587583+0000", 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5176000000000001e-05 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.593451+0000", 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058679650000000002 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.593553+0000", 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010244800000000001 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 65/31 ECSubWrite(tid=212, reqid=osd.6.0:212, at_version=65'40, trim_to=0'0, roll_forward_to=62'38))", 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:32.474958+0000", 2024-04-26T02:24:33.651 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.09060998, 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0062279070000000004, 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.474958+0000", 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.474958+0000", 2024-04-26T02:24:33.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.474958+0000", 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9700000000000003e-07 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.474978+0000", 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9606000000000002e-05 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.474993+0000", 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5007999999999999e-05 2024-04-26T02:24:33.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.475005+0000", 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2649999999999999e-05 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.475135+0000", 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000129407 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.475149+0000", 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4022000000000001e-05 2024-04-26T02:24:33.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.481086+0000", 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0059372610000000001 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.481186+0000", 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9655999999999996e-05 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 65/31 ECSubWrite(tid=213, reqid=osd.6.0:213, at_version=65'42, trim_to=0'0, roll_forward_to=62'38))", 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:32.476207+0000", 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.0893609989999999, 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073965029999999996, 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476207+0000", 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476207+0000", 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476208+0000", 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1299999999999998e-07 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476237+0000", 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9869000000000002e-05 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476255+0000", 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7859999999999998e-05 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476270+0000", 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4253999999999999e-05 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476391+0000", 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000121321 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.476405+0000", 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3874e-05 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.483531+0000", 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071258329999999998 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:32.483603+0000", 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2578999999999997e-05 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:33.660 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:33.660 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:33.660 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:33.661 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:33.662 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:33.663 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:33.660+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:33.672 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:33.673 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:33.698 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:33.698 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:33.719 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:33.719 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:33.752 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:33.753 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:33.764 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:33.762+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:33.788 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:33.788 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:33.817 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:33.834 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:33.835 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:33.835 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:33.835 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:33.838 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:33.838 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:33.849 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:33.856 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:33.856 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:33.877 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:33.877 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:33.894 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:33.891+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:33.895 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:33.895 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:33.916 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:33.916 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:33.934 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:33.934 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:33.955 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:33.955 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:33.966 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:33.960+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:33.970 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:33.970 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:33.970 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:33.975 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:33.976 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:33.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:33.976+0000 7f4fa8f4e640 0 -- 172.21.15.59:0/3976873911 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f4fa42243a0 msgr2=0x7f4fa4226790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:33.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:33.997 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:34.070 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:34.067+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:34.146 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:34.146 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:34.161 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:34.168 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:34.168+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:34.269 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:34.266+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:34.294 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:34.294 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:34.309 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:34.370 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:34.367+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:34.466 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.15 to 1 (10000) 2024-04-26T02:24:34.471 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:34.468+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:34.473 INFO:tasks.rados.rados.0.smithi175.stdout:218: done (0 left) 2024-04-26T02:24:34.473 INFO:tasks.rados.rados.0.smithi175.stdout:219: copy_from oid 29 from oid 50 current snap is 19 2024-04-26T02:24:34.473 INFO:tasks.rados.rados.0.smithi175.stdout:220: delete oid 3 current snap is 19 2024-04-26T02:24:34.475 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:34.475 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:34.478 INFO:tasks.rados.rados.0.smithi175.stdout:219: finishing copy_from to smithi17529564-29 2024-04-26T02:24:34.478 INFO:tasks.rados.rados.0.smithi175.stdout:219: got expected ENOENT (src dne) 2024-04-26T02:24:34.478 INFO:tasks.rados.rados.0.smithi175.stdout:219: finishing copy_from racing read to smithi17529564-29 2024-04-26T02:24:34.484 INFO:tasks.rados.rados.0.smithi175.stdout:219: done (1 left) 2024-04-26T02:24:34.484 INFO:tasks.rados.rados.0.smithi175.stdout:220: done (0 left) 2024-04-26T02:24:34.484 INFO:tasks.rados.rados.0.smithi175.stdout:221: snap_create 2024-04-26T02:24:34.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:34.493 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T02:24:34.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:34.572 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:34.568+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:34.612 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:34.612 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:34.626 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:34.673 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:34.670+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:34.749 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:34.749 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:34.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:34.774 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:34.771+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:34.850 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:34.851 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:34.869 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-26T02:24:34.721361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82477600,"num_objects":70,"num_object_clones":21,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":5,"num_read":385,"num_read_kb":56357,"num_write":705,"num_write_kb":92388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":774,"ondisk_log_size":774,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":618088,"kb_used_data":156572,"kb_used_omap":24,"kb_used_meta":461223,"kb_avail":1509331352,"statfs":{"total":1546188226560,"available":1545555304448,"internally_reserved":0,"allocated":160329728,"data_stored":197748397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":472292435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8847360,"num_objects":-2,"num_object_clones":-2,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":3,"num_read":16,"num_read_kb":13206,"num_write":29,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000810"},"pg_stats":[{"pgid":"3.f","version":"66'52","reported_seq":231,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.497809+0000","last_change":"2024-04-26T02:24:33.499294+0000","last_active":"2024-04-26T02:24:33.497809+0000","last_peered":"2024-04-26T02:24:33.497809+0000","last_clean":"2024-04-26T02:24:33.497809+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:33.497809+0000","last_undegraded":"2024-04-26T02:24:33.497809+0000","last_fullsized":"2024-04-26T02:24:33.497809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.003143+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.026737884,"stat_sum":{"num_bytes":6144000,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4137,"num_write":24,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.e","version":"59'24","reported_seq":183,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594181+0000","last_change":"2024-04-26T02:24:26.576842+0000","last_active":"2024-04-26T02:24:30.594181+0000","last_peered":"2024-04-26T02:24:30.594181+0000","last_clean":"2024-04-26T02:24:30.594181+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:30.594181+0000","last_undegraded":"2024-04-26T02:24:30.594181+0000","last_fullsized":"2024-04-26T02:24:30.594181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.999142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019943450000000001,"stat_sum":{"num_bytes":2015232,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":12,"num_read_kb":1005,"num_write":32,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.d","version":"66'60","reported_seq":241,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.487723+0000","last_change":"2024-04-26T02:24:33.488866+0000","last_active":"2024-04-26T02:24:33.487723+0000","last_peered":"2024-04-26T02:24:33.487723+0000","last_clean":"2024-04-26T02:24:33.487723+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:33.487723+0000","last_undegraded":"2024-04-26T02:24:33.487723+0000","last_fullsized":"2024-04-26T02:24:33.487723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.306561+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.021325637000000001,"stat_sum":{"num_bytes":13320192,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":4622,"num_write":57,"num_write_kb":14752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.c","version":"66'116","reported_seq":293,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.523316+0000","last_change":"2024-04-26T02:24:33.524263+0000","last_active":"2024-04-26T02:24:33.523316+0000","last_peered":"2024-04-26T02:24:33.523316+0000","last_clean":"2024-04-26T02:24:33.523316+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:33.523316+0000","last_undegraded":"2024-04-26T02:24:33.523316+0000","last_fullsized":"2024-04-26T02:24:33.523316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.392533+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.051788835999999998,"stat_sum":{"num_bytes":14860288,"num_objects":12,"num_object_clones":4,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":40,"num_read_kb":15571,"num_write":54,"num_write_kb":14512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.b","version":"61'25","reported_seq":186,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.604659+0000","last_change":"2024-04-26T02:24:26.584877+0000","last_active":"2024-04-26T02:24:31.604659+0000","last_peered":"2024-04-26T02:24:31.604659+0000","last_clean":"2024-04-26T02:24:31.604659+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:31.604659+0000","last_undegraded":"2024-04-26T02:24:31.604659+0000","last_fullsized":"2024-04-26T02:24:31.604659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:59.385832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027133043999999999,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":37,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.a","version":"66'52","reported_seq":220,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.492664+0000","last_change":"2024-04-26T02:24:33.493979+0000","last_active":"2024-04-26T02:24:33.492664+0000","last_peered":"2024-04-26T02:24:33.492664+0000","last_clean":"2024-04-26T02:24:33.492664+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:33.492664+0000","last_undegraded":"2024-04-26T02:24:33.492664+0000","last_fullsized":"2024-04-26T02:24:33.492664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:27.087079+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.026785796000000001,"stat_sum":{"num_bytes":4292608,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":42,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.9","version":"62'34","reported_seq":192,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594156+0000","last_change":"2024-04-26T02:24:26.574175+0000","last_active":"2024-04-26T02:24:30.594156+0000","last_peered":"2024-04-26T02:24:30.594156+0000","last_clean":"2024-04-26T02:24:30.594156+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:30.594156+0000","last_undegraded":"2024-04-26T02:24:30.594156+0000","last_fullsized":"2024-04-26T02:24:30.594156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.771634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017376084,"stat_sum":{"num_bytes":4243456,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":15,"num_read_kb":247,"num_write":38,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.8","version":"62'38","reported_seq":198,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.105226+0000","last_change":"2024-04-26T02:24:26.591156+0000","last_active":"2024-04-26T02:24:31.105226+0000","last_peered":"2024-04-26T02:24:31.105226+0000","last_clean":"2024-04-26T02:24:31.105226+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:31.105226+0000","last_undegraded":"2024-04-26T02:24:31.105226+0000","last_fullsized":"2024-04-26T02:24:31.105226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.554416+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.026491961000000001,"stat_sum":{"num_bytes":4259840,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":3129,"num_write":40,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":281,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.105998+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:31.105998+0000","last_peered":"2024-04-26T02:24:31.105998+0000","last_clean":"2024-04-26T02:24:31.105998+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:31.105998+0000","last_undegraded":"2024-04-26T02:24:31.105998+0000","last_fullsized":"2024-04-26T02:24:31.105998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594701+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:30.594701+0000","last_peered":"2024-04-26T02:24:30.594701+0000","last_clean":"2024-04-26T02:24:30.594701+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:30.594701+0000","last_undegraded":"2024-04-26T02:24:30.594701+0000","last_fullsized":"2024-04-26T02:24:30.594701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"59'18","reported_seq":172,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594680+0000","last_change":"2024-04-26T02:24:26.592442+0000","last_active":"2024-04-26T02:24:30.594680+0000","last_peered":"2024-04-26T02:24:30.594680+0000","last_clean":"2024-04-26T02:24:30.594680+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:30.594680+0000","last_undegraded":"2024-04-26T02:24:30.594680+0000","last_fullsized":"2024-04-26T02:24:30.594680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.940741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024896244000000001,"stat_sum":{"num_bytes":2326528,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":10,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.477888+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:33.477888+0000","last_peered":"2024-04-26T02:24:33.477888+0000","last_clean":"2024-04-26T02:24:33.477888+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:33.477888+0000","last_undegraded":"2024-04-26T02:24:33.477888+0000","last_fullsized":"2024-04-26T02:24:33.477888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"59'36","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.592933+0000","last_change":"2024-04-26T02:24:26.604225+0000","last_active":"2024-04-26T02:24:29.592933+0000","last_peered":"2024-04-26T02:24:29.592933+0000","last_clean":"2024-04-26T02:24:29.592933+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:29.592933+0000","last_undegraded":"2024-04-26T02:24:29.592933+0000","last_fullsized":"2024-04-26T02:24:29.592933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:11.487019+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.035630457999999997,"stat_sum":{"num_bytes":9289728,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":13208,"num_write":21,"num_write_kb":9568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594412+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:30.594412+0000","last_peered":"2024-04-26T02:24:30.594412+0000","last_clean":"2024-04-26T02:24:30.594412+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:30.594412+0000","last_undegraded":"2024-04-26T02:24:30.594412+0000","last_fullsized":"2024-04-26T02:24:30.594412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"60'31","reported_seq":189,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.104894+0000","last_change":"2024-04-26T02:24:26.590232+0000","last_active":"2024-04-26T02:24:31.104894+0000","last_peered":"2024-04-26T02:24:31.104894+0000","last_clean":"2024-04-26T02:24:31.104894+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:31.104894+0000","last_undegraded":"2024-04-26T02:24:31.104894+0000","last_fullsized":"2024-04-26T02:24:31.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:17.318327+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.024097169000000002,"stat_sum":{"num_bytes":6848512,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":2360,"num_write":22,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.478895+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:33.478895+0000","last_peered":"2024-04-26T02:24:33.478895+0000","last_clean":"2024-04-26T02:24:33.478895+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:33.478895+0000","last_undegraded":"2024-04-26T02:24:33.478895+0000","last_fullsized":"2024-04-26T02:24:33.478895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.475901+0000","last_change":"2024-04-26T02:24:26.579801+0000","last_active":"2024-04-26T02:24:29.475901+0000","last_peered":"2024-04-26T02:24:29.475901+0000","last_clean":"2024-04-26T02:24:29.475901+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:29.475901+0000","last_undegraded":"2024-04-26T02:24:29.475901+0000","last_fullsized":"2024-04-26T02:24:29.475901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.355461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084172220000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.5","version":"66'53","reported_seq":235,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.497540+0000","last_change":"2024-04-26T02:24:33.499282+0000","last_active":"2024-04-26T02:24:33.497540+0000","last_peered":"2024-04-26T02:24:33.497540+0000","last_clean":"2024-04-26T02:24:33.497540+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:33.497540+0000","last_undegraded":"2024-04-26T02:24:33.497540+0000","last_fullsized":"2024-04-26T02:24:33.497540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.925123+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.020982924999999999,"stat_sum":{"num_bytes":3473408,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":4831,"num_write":66,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.475971+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:29.475971+0000","last_peered":"2024-04-26T02:24:29.475971+0000","last_clean":"2024-04-26T02:24:29.475971+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:29.475971+0000","last_undegraded":"2024-04-26T02:24:29.475971+0000","last_fullsized":"2024-04-26T02:24:29.475971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.604762+0000","last_change":"2024-04-26T02:24:26.558401+0000","last_active":"2024-04-26T02:24:31.604762+0000","last_peered":"2024-04-26T02:24:31.604762+0000","last_clean":"2024-04-26T02:24:31.604762+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:31.604762+0000","last_undegraded":"2024-04-26T02:24:31.604762+0000","last_fullsized":"2024-04-26T02:24:31.604762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:59.241074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001126724,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.104280+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:31.104280+0000","last_peered":"2024-04-26T02:24:31.104280+0000","last_clean":"2024-04-26T02:24:31.104280+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:31.104280+0000","last_undegraded":"2024-04-26T02:24:31.104280+0000","last_fullsized":"2024-04-26T02:24:31.104280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"59'22","reported_seq":173,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.500679+0000","last_change":"2024-04-26T02:24:26.599572+0000","last_active":"2024-04-26T02:24:29.500679+0000","last_peered":"2024-04-26T02:24:29.500679+0000","last_clean":"2024-04-26T02:24:29.500679+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:29.500679+0000","last_undegraded":"2024-04-26T02:24:29.500679+0000","last_fullsized":"2024-04-26T02:24:29.500679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:06.730991+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.020131456999999998,"stat_sum":{"num_bytes":770048,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":8,"num_write_kb":752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.605970+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:31.605970+0000","last_peered":"2024-04-26T02:24:31.605970+0000","last_clean":"2024-04-26T02:24:31.605970+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:31.605970+0000","last_undegraded":"2024-04-26T02:24:31.605970+0000","last_fullsized":"2024-04-26T02:24:31.605970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"62'56","reported_seq":216,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.606154+0000","last_change":"2024-04-26T02:24:26.588132+0000","last_active":"2024-04-26T02:24:31.606154+0000","last_peered":"2024-04-26T02:24:31.606154+0000","last_clean":"2024-04-26T02:24:31.606154+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:31.606154+0000","last_undegraded":"2024-04-26T02:24:31.606154+0000","last_fullsized":"2024-04-26T02:24:31.606154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:02.605200+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.031451667000000003,"stat_sum":{"num_bytes":6733824,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":7113,"num_write":51,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.478003+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:33.478003+0000","last_peered":"2024-04-26T02:24:33.478003+0000","last_clean":"2024-04-26T02:24:33.478003+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:33.478003+0000","last_undegraded":"2024-04-26T02:24:33.478003+0000","last_fullsized":"2024-04-26T02:24:33.478003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":81887232,"num_objects":68,"num_object_clones":21,"num_object_copies":476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":5,"num_read":249,"num_read_kb":56239,"num_write":502,"num_write_kb":88928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144179200,"data_stored":179056640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":617,"ondisk_log_size":617,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215119,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42440,"kb_used_data":11256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329400,"statfs":{"total":96636764160,"available":96593305600,"internally_reserved":0,"allocated":11526144,"data_stored":15824460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215116,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37780,"kb_used_data":6592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334060,"statfs":{"total":96636764160,"available":96598077440,"internally_reserved":0,"allocated":6750208,"data_stored":7898700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215116,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43204,"kb_used_data":12020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328636,"statfs":{"total":96636764160,"available":96592523264,"internally_reserved":0,"allocated":12308480,"data_stored":14345804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313227,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39716,"kb_used_data":12692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332124,"statfs":{"total":96636764160,"available":96596094976,"internally_reserved":0,"allocated":12996608,"data_stored":17460561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38972,"kb_used_data":7784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332868,"statfs":{"total":96636764160,"available":96596856832,"internally_reserved":0,"allocated":7970816,"data_stored":9313617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280524,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":4624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":4734976,"data_stored":5012817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280525,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41764,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330076,"statfs":{"total":96636764160,"available":96593997824,"internally_reserved":0,"allocated":15093760,"data_stored":19639633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":10288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":10534912,"data_stored":11937146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34868,"kb_used_data":7848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336972,"statfs":{"total":96636764160,"available":96601059328,"internally_reserved":0,"allocated":8036352,"data_stored":8594810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38004,"kb_used_data":10976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333836,"statfs":{"total":96636764160,"available":96597848064,"internally_reserved":0,"allocated":11239424,"data_stored":14415226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280523,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":5624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":5758976,"data_stored":5633946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34476,"kb_used_data":7448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337364,"statfs":{"total":96636764160,"available":96601460736,"internally_reserved":0,"allocated":7626752,"data_stored":9074586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280523,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41804,"kb_used_data":10624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330036,"statfs":{"total":96636764160,"available":96593956864,"internally_reserved":0,"allocated":10878976,"data_stored":14929315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40212,"kb_used_data":13192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331628,"statfs":{"total":96636764160,"available":96595587072,"internally_reserved":0,"allocated":13508608,"data_stored":18101626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33856,"kb_used_data":6828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337984,"statfs":{"total":96636764160,"available":96602095616,"internally_reserved":0,"allocated":6991872,"data_stored":7411066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215116,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45224,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326616,"statfs":{"total":96636764160,"available":96590454784,"internally_reserved":0,"allocated":14372864,"data_stored":18155084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12759040,"data_stored":14839808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":19173376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7172096,"data_stored":8118272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12275712,"data_stored":17121280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10907648,"data_stored":10948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4362240,"data_stored":4628480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6230016,"data_stored":8069120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9998336,"data_stored":14442496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5771264,"data_stored":5771264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12644352,"data_stored":17625088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":8847360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":3887104,"data_stored":4546560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":12591104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6934528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":9670656,"data_stored":11460608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":10375168,"data_stored":13938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:34.871 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:34.875 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:34.871+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:34.928 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:34.929 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:34.942 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:34.975 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:34.976+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:35.066 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:35.066 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:35.077 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:35.071+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:35.080 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:35.174 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:35.174 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:35.177 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:35.176+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:35.192 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-04-26T02:24:34.721361+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82477600,"num_objects":70,"num_object_clones":21,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":5,"num_read":385,"num_read_kb":56357,"num_write":705,"num_write_kb":92388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":774,"ondisk_log_size":774,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":618088,"kb_used_data":156572,"kb_used_omap":24,"kb_used_meta":461223,"kb_avail":1509331352,"statfs":{"total":1546188226560,"available":1545555304448,"internally_reserved":0,"allocated":160329728,"data_stored":197748397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":472292435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8847360,"num_objects":-2,"num_object_clones":-2,"num_object_copies":-14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":3,"num_read":16,"num_read_kb":13206,"num_write":29,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000810"},"pg_stats":[{"pgid":"3.f","version":"66'52","reported_seq":231,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.497809+0000","last_change":"2024-04-26T02:24:33.499294+0000","last_active":"2024-04-26T02:24:33.497809+0000","last_peered":"2024-04-26T02:24:33.497809+0000","last_clean":"2024-04-26T02:24:33.497809+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:33.497809+0000","last_undegraded":"2024-04-26T02:24:33.497809+0000","last_fullsized":"2024-04-26T02:24:33.497809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.003143+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.026737884,"stat_sum":{"num_bytes":6144000,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4137,"num_write":24,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.e","version":"59'24","reported_seq":183,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594181+0000","last_change":"2024-04-26T02:24:26.576842+0000","last_active":"2024-04-26T02:24:30.594181+0000","last_peered":"2024-04-26T02:24:30.594181+0000","last_clean":"2024-04-26T02:24:30.594181+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:30.594181+0000","last_undegraded":"2024-04-26T02:24:30.594181+0000","last_fullsized":"2024-04-26T02:24:30.594181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.999142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019943450000000001,"stat_sum":{"num_bytes":2015232,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":12,"num_read_kb":1005,"num_write":32,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.d","version":"66'60","reported_seq":241,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.487723+0000","last_change":"2024-04-26T02:24:33.488866+0000","last_active":"2024-04-26T02:24:33.487723+0000","last_peered":"2024-04-26T02:24:33.487723+0000","last_clean":"2024-04-26T02:24:33.487723+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:33.487723+0000","last_undegraded":"2024-04-26T02:24:33.487723+0000","last_fullsized":"2024-04-26T02:24:33.487723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.306561+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.021325637000000001,"stat_sum":{"num_bytes":13320192,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":4622,"num_write":57,"num_write_kb":14752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.c","version":"66'116","reported_seq":293,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.523316+0000","last_change":"2024-04-26T02:24:33.524263+0000","last_active":"2024-04-26T02:24:33.523316+0000","last_peered":"2024-04-26T02:24:33.523316+0000","last_clean":"2024-04-26T02:24:33.523316+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:33.523316+0000","last_undegraded":"2024-04-26T02:24:33.523316+0000","last_fullsized":"2024-04-26T02:24:33.523316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.392533+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.051788835999999998,"stat_sum":{"num_bytes":14860288,"num_objects":12,"num_object_clones":4,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":40,"num_read_kb":15571,"num_write":54,"num_write_kb":14512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.b","version":"61'25","reported_seq":186,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.604659+0000","last_change":"2024-04-26T02:24:26.584877+0000","last_active":"2024-04-26T02:24:31.604659+0000","last_peered":"2024-04-26T02:24:31.604659+0000","last_clean":"2024-04-26T02:24:31.604659+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:31.604659+0000","last_undegraded":"2024-04-26T02:24:31.604659+0000","last_fullsized":"2024-04-26T02:24:31.604659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:59.385832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027133043999999999,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":37,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.a","version":"66'52","reported_seq":220,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.492664+0000","last_change":"2024-04-26T02:24:33.493979+0000","last_active":"2024-04-26T02:24:33.492664+0000","last_peered":"2024-04-26T02:24:33.492664+0000","last_clean":"2024-04-26T02:24:33.492664+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:33.492664+0000","last_undegraded":"2024-04-26T02:24:33.492664+0000","last_fullsized":"2024-04-26T02:24:33.492664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:27.087079+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.026785796000000001,"stat_sum":{"num_bytes":4292608,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":42,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.9","version":"62'34","reported_seq":192,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594156+0000","last_change":"2024-04-26T02:24:26.574175+0000","last_active":"2024-04-26T02:24:30.594156+0000","last_peered":"2024-04-26T02:24:30.594156+0000","last_clean":"2024-04-26T02:24:30.594156+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:30.594156+0000","last_undegraded":"2024-04-26T02:24:30.594156+0000","last_fullsized":"2024-04-26T02:24:30.594156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.771634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017376084,"stat_sum":{"num_bytes":4243456,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":15,"num_read_kb":247,"num_write":38,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.8","version":"62'38","reported_seq":198,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.105226+0000","last_change":"2024-04-26T02:24:26.591156+0000","last_active":"2024-04-26T02:24:31.105226+0000","last_peered":"2024-04-26T02:24:31.105226+0000","last_clean":"2024-04-26T02:24:31.105226+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:31.105226+0000","last_undegraded":"2024-04-26T02:24:31.105226+0000","last_fullsized":"2024-04-26T02:24:31.105226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.554416+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.026491961000000001,"stat_sum":{"num_bytes":4259840,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":3129,"num_write":40,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":281,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.105998+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:31.105998+0000","last_peered":"2024-04-26T02:24:31.105998+0000","last_clean":"2024-04-26T02:24:31.105998+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:31.105998+0000","last_undegraded":"2024-04-26T02:24:31.105998+0000","last_fullsized":"2024-04-26T02:24:31.105998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594701+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:30.594701+0000","last_peered":"2024-04-26T02:24:30.594701+0000","last_clean":"2024-04-26T02:24:30.594701+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:30.594701+0000","last_undegraded":"2024-04-26T02:24:30.594701+0000","last_fullsized":"2024-04-26T02:24:30.594701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"59'18","reported_seq":172,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594680+0000","last_change":"2024-04-26T02:24:26.592442+0000","last_active":"2024-04-26T02:24:30.594680+0000","last_peered":"2024-04-26T02:24:30.594680+0000","last_clean":"2024-04-26T02:24:30.594680+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:30.594680+0000","last_undegraded":"2024-04-26T02:24:30.594680+0000","last_fullsized":"2024-04-26T02:24:30.594680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.940741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024896244000000001,"stat_sum":{"num_bytes":2326528,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":10,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.477888+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:33.477888+0000","last_peered":"2024-04-26T02:24:33.477888+0000","last_clean":"2024-04-26T02:24:33.477888+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:33.477888+0000","last_undegraded":"2024-04-26T02:24:33.477888+0000","last_fullsized":"2024-04-26T02:24:33.477888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"59'36","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.592933+0000","last_change":"2024-04-26T02:24:26.604225+0000","last_active":"2024-04-26T02:24:29.592933+0000","last_peered":"2024-04-26T02:24:29.592933+0000","last_clean":"2024-04-26T02:24:29.592933+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:29.592933+0000","last_undegraded":"2024-04-26T02:24:29.592933+0000","last_fullsized":"2024-04-26T02:24:29.592933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:11.487019+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.035630457999999997,"stat_sum":{"num_bytes":9289728,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":13208,"num_write":21,"num_write_kb":9568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594412+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:30.594412+0000","last_peered":"2024-04-26T02:24:30.594412+0000","last_clean":"2024-04-26T02:24:30.594412+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:30.594412+0000","last_undegraded":"2024-04-26T02:24:30.594412+0000","last_fullsized":"2024-04-26T02:24:30.594412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"60'31","reported_seq":189,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.104894+0000","last_change":"2024-04-26T02:24:26.590232+0000","last_active":"2024-04-26T02:24:31.104894+0000","last_peered":"2024-04-26T02:24:31.104894+0000","last_clean":"2024-04-26T02:24:31.104894+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:31.104894+0000","last_undegraded":"2024-04-26T02:24:31.104894+0000","last_fullsized":"2024-04-26T02:24:31.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:17.318327+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.024097169000000002,"stat_sum":{"num_bytes":6848512,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":2360,"num_write":22,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.478895+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:33.478895+0000","last_peered":"2024-04-26T02:24:33.478895+0000","last_clean":"2024-04-26T02:24:33.478895+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:33.478895+0000","last_undegraded":"2024-04-26T02:24:33.478895+0000","last_fullsized":"2024-04-26T02:24:33.478895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.475901+0000","last_change":"2024-04-26T02:24:26.579801+0000","last_active":"2024-04-26T02:24:29.475901+0000","last_peered":"2024-04-26T02:24:29.475901+0000","last_clean":"2024-04-26T02:24:29.475901+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:29.475901+0000","last_undegraded":"2024-04-26T02:24:29.475901+0000","last_fullsized":"2024-04-26T02:24:29.475901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.355461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084172220000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.5","version":"66'53","reported_seq":235,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.497540+0000","last_change":"2024-04-26T02:24:33.499282+0000","last_active":"2024-04-26T02:24:33.497540+0000","last_peered":"2024-04-26T02:24:33.497540+0000","last_clean":"2024-04-26T02:24:33.497540+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:33.497540+0000","last_undegraded":"2024-04-26T02:24:33.497540+0000","last_fullsized":"2024-04-26T02:24:33.497540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.925123+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.020982924999999999,"stat_sum":{"num_bytes":3473408,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":4831,"num_write":66,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.475971+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:29.475971+0000","last_peered":"2024-04-26T02:24:29.475971+0000","last_clean":"2024-04-26T02:24:29.475971+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:29.475971+0000","last_undegraded":"2024-04-26T02:24:29.475971+0000","last_fullsized":"2024-04-26T02:24:29.475971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.604762+0000","last_change":"2024-04-26T02:24:26.558401+0000","last_active":"2024-04-26T02:24:31.604762+0000","last_peered":"2024-04-26T02:24:31.604762+0000","last_clean":"2024-04-26T02:24:31.604762+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:31.604762+0000","last_undegraded":"2024-04-26T02:24:31.604762+0000","last_fullsized":"2024-04-26T02:24:31.604762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:59.241074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001126724,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.104280+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:31.104280+0000","last_peered":"2024-04-26T02:24:31.104280+0000","last_clean":"2024-04-26T02:24:31.104280+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:31.104280+0000","last_undegraded":"2024-04-26T02:24:31.104280+0000","last_fullsized":"2024-04-26T02:24:31.104280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"59'22","reported_seq":173,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.500679+0000","last_change":"2024-04-26T02:24:26.599572+0000","last_active":"2024-04-26T02:24:29.500679+0000","last_peered":"2024-04-26T02:24:29.500679+0000","last_clean":"2024-04-26T02:24:29.500679+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:29.500679+0000","last_undegraded":"2024-04-26T02:24:29.500679+0000","last_fullsized":"2024-04-26T02:24:29.500679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:06.730991+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.020131456999999998,"stat_sum":{"num_bytes":770048,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":8,"num_write_kb":752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.605970+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:31.605970+0000","last_peered":"2024-04-26T02:24:31.605970+0000","last_clean":"2024-04-26T02:24:31.605970+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:31.605970+0000","last_undegraded":"2024-04-26T02:24:31.605970+0000","last_fullsized":"2024-04-26T02:24:31.605970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"62'56","reported_seq":216,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.606154+0000","last_change":"2024-04-26T02:24:26.588132+0000","last_active":"2024-04-26T02:24:31.606154+0000","last_peered":"2024-04-26T02:24:31.606154+0000","last_clean":"2024-04-26T02:24:31.606154+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:31.606154+0000","last_undegraded":"2024-04-26T02:24:31.606154+0000","last_fullsized":"2024-04-26T02:24:31.606154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:02.605200+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.031451667000000003,"stat_sum":{"num_bytes":6733824,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":7113,"num_write":51,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.478003+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:33.478003+0000","last_peered":"2024-04-26T02:24:33.478003+0000","last_clean":"2024-04-26T02:24:33.478003+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:33.478003+0000","last_undegraded":"2024-04-26T02:24:33.478003+0000","last_fullsized":"2024-04-26T02:24:33.478003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":81887232,"num_objects":68,"num_object_clones":21,"num_object_copies":476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":5,"num_read":249,"num_read_kb":56239,"num_write":502,"num_write_kb":88928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":144179200,"data_stored":179056640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":617,"ondisk_log_size":617,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215119,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42440,"kb_used_data":11256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329400,"statfs":{"total":96636764160,"available":96593305600,"internally_reserved":0,"allocated":11526144,"data_stored":15824460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215116,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37780,"kb_used_data":6592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334060,"statfs":{"total":96636764160,"available":96598077440,"internally_reserved":0,"allocated":6750208,"data_stored":7898700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215116,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43204,"kb_used_data":12020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328636,"statfs":{"total":96636764160,"available":96592523264,"internally_reserved":0,"allocated":12308480,"data_stored":14345804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313227,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39716,"kb_used_data":12692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332124,"statfs":{"total":96636764160,"available":96596094976,"internally_reserved":0,"allocated":12996608,"data_stored":17460561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38972,"kb_used_data":7784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332868,"statfs":{"total":96636764160,"available":96596856832,"internally_reserved":0,"allocated":7970816,"data_stored":9313617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280524,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":4624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":4734976,"data_stored":5012817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280525,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41764,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330076,"statfs":{"total":96636764160,"available":96593997824,"internally_reserved":0,"allocated":15093760,"data_stored":19639633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":10288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":10534912,"data_stored":11937146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34868,"kb_used_data":7848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336972,"statfs":{"total":96636764160,"available":96601059328,"internally_reserved":0,"allocated":8036352,"data_stored":8594810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38004,"kb_used_data":10976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333836,"statfs":{"total":96636764160,"available":96597848064,"internally_reserved":0,"allocated":11239424,"data_stored":14415226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280523,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":5624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":5758976,"data_stored":5633946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34476,"kb_used_data":7448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337364,"statfs":{"total":96636764160,"available":96601460736,"internally_reserved":0,"allocated":7626752,"data_stored":9074586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280523,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41804,"kb_used_data":10624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330036,"statfs":{"total":96636764160,"available":96593956864,"internally_reserved":0,"allocated":10878976,"data_stored":14929315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40212,"kb_used_data":13192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331628,"statfs":{"total":96636764160,"available":96595587072,"internally_reserved":0,"allocated":13508608,"data_stored":18101626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33856,"kb_used_data":6828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337984,"statfs":{"total":96636764160,"available":96602095616,"internally_reserved":0,"allocated":6991872,"data_stored":7411066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215116,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45224,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326616,"statfs":{"total":96636764160,"available":96590454784,"internally_reserved":0,"allocated":14372864,"data_stored":18155084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12759040,"data_stored":14839808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":19173376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7172096,"data_stored":8118272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12275712,"data_stored":17121280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10907648,"data_stored":10948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4362240,"data_stored":4628480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6230016,"data_stored":8069120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9998336,"data_stored":14442496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5771264,"data_stored":5771264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12644352,"data_stored":17625088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":8847360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":3887104,"data_stored":4546560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":12591104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6934528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":9670656,"data_stored":11460608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":10375168,"data_stored":13938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:35.194 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T02:24:35.194 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:35.195 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-04-26T02:24:35.195 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-04-26T02:24:35.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:35.203 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:35.203 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:35.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:35.278 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:35.271+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:35.335 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:35.335 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:35.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:24:35.379 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:35.380+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:35.468 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:35.468 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:35.475 INFO:tasks.rados.rados.0.smithi175.stdout:221: done (0 left) 2024-04-26T02:24:35.476 INFO:tasks.rados.rados.0.smithi175.stdout:222: snap_create 2024-04-26T02:24:35.480 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:35.475+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:35.484 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:24:35.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T02:24:35.550 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:35.550 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:35.566 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-26T02:24:35.470486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82477600,"num_objects":70,"num_object_clones":21,"num_object_copies":480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":6,"num_read":385,"num_read_kb":56357,"num_write":706,"num_write_kb":92388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":778,"ondisk_log_size":778,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":617936,"kb_used_data":156424,"kb_used_omap":24,"kb_used_meta":461223,"kb_avail":1509331504,"statfs":{"total":1546188226560,"available":1545555460096,"internally_reserved":0,"allocated":160178176,"data_stored":194039858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":472292435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8847360,"num_objects":-1,"num_object_clones":-1,"num_object_copies":-7,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":4,"num_read":8,"num_read_kb":4,"num_write":30,"num_write_kb":9856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.868853"},"pg_stats":[{"pgid":"3.f","version":"66'52","reported_seq":231,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.497809+0000","last_change":"2024-04-26T02:24:33.499294+0000","last_active":"2024-04-26T02:24:33.497809+0000","last_peered":"2024-04-26T02:24:33.497809+0000","last_clean":"2024-04-26T02:24:33.497809+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:33.497809+0000","last_undegraded":"2024-04-26T02:24:33.497809+0000","last_fullsized":"2024-04-26T02:24:33.497809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.003143+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.026737884,"stat_sum":{"num_bytes":6144000,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4137,"num_write":24,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.e","version":"59'24","reported_seq":183,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594181+0000","last_change":"2024-04-26T02:24:26.576842+0000","last_active":"2024-04-26T02:24:30.594181+0000","last_peered":"2024-04-26T02:24:30.594181+0000","last_clean":"2024-04-26T02:24:30.594181+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:30.594181+0000","last_undegraded":"2024-04-26T02:24:30.594181+0000","last_fullsized":"2024-04-26T02:24:30.594181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.999142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.019943450000000001,"stat_sum":{"num_bytes":2015232,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":12,"num_read_kb":1005,"num_write":32,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.d","version":"66'60","reported_seq":241,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.487723+0000","last_change":"2024-04-26T02:24:33.488866+0000","last_active":"2024-04-26T02:24:33.487723+0000","last_peered":"2024-04-26T02:24:33.487723+0000","last_clean":"2024-04-26T02:24:33.487723+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:33.487723+0000","last_undegraded":"2024-04-26T02:24:33.487723+0000","last_fullsized":"2024-04-26T02:24:33.487723+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.306561+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.021325637000000001,"stat_sum":{"num_bytes":13320192,"num_objects":5,"num_object_clones":0,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":4622,"num_write":57,"num_write_kb":14752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.c","version":"66'116","reported_seq":293,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.523316+0000","last_change":"2024-04-26T02:24:33.524263+0000","last_active":"2024-04-26T02:24:33.523316+0000","last_peered":"2024-04-26T02:24:33.523316+0000","last_clean":"2024-04-26T02:24:33.523316+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:33.523316+0000","last_undegraded":"2024-04-26T02:24:33.523316+0000","last_fullsized":"2024-04-26T02:24:33.523316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.392533+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.051788835999999998,"stat_sum":{"num_bytes":14860288,"num_objects":12,"num_object_clones":4,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":40,"num_read_kb":15571,"num_write":54,"num_write_kb":14512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.b","version":"61'25","reported_seq":186,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.604659+0000","last_change":"2024-04-26T02:24:26.584877+0000","last_active":"2024-04-26T02:24:31.604659+0000","last_peered":"2024-04-26T02:24:31.604659+0000","last_clean":"2024-04-26T02:24:31.604659+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:31.604659+0000","last_undegraded":"2024-04-26T02:24:31.604659+0000","last_fullsized":"2024-04-26T02:24:31.604659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:59.385832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027133043999999999,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":37,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.a","version":"66'52","reported_seq":220,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.492664+0000","last_change":"2024-04-26T02:24:33.493979+0000","last_active":"2024-04-26T02:24:33.492664+0000","last_peered":"2024-04-26T02:24:33.492664+0000","last_clean":"2024-04-26T02:24:33.492664+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:33.492664+0000","last_undegraded":"2024-04-26T02:24:33.492664+0000","last_fullsized":"2024-04-26T02:24:33.492664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:27.087079+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.026785796000000001,"stat_sum":{"num_bytes":4292608,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":42,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.9","version":"62'34","reported_seq":192,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594156+0000","last_change":"2024-04-26T02:24:26.574175+0000","last_active":"2024-04-26T02:24:30.594156+0000","last_peered":"2024-04-26T02:24:30.594156+0000","last_clean":"2024-04-26T02:24:30.594156+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:30.594156+0000","last_undegraded":"2024-04-26T02:24:30.594156+0000","last_fullsized":"2024-04-26T02:24:30.594156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.771634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017376084,"stat_sum":{"num_bytes":4243456,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":2,"num_read":15,"num_read_kb":247,"num_write":38,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.8","version":"62'38","reported_seq":198,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.105226+0000","last_change":"2024-04-26T02:24:26.591156+0000","last_active":"2024-04-26T02:24:31.105226+0000","last_peered":"2024-04-26T02:24:31.105226+0000","last_clean":"2024-04-26T02:24:31.105226+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:31.105226+0000","last_undegraded":"2024-04-26T02:24:31.105226+0000","last_fullsized":"2024-04-26T02:24:31.105226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.554416+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.026491961000000001,"stat_sum":{"num_bytes":4259840,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":3129,"num_write":40,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":281,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.105998+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:31.105998+0000","last_peered":"2024-04-26T02:24:31.105998+0000","last_clean":"2024-04-26T02:24:31.105998+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:31.105998+0000","last_undegraded":"2024-04-26T02:24:31.105998+0000","last_fullsized":"2024-04-26T02:24:31.105998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594701+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:30.594701+0000","last_peered":"2024-04-26T02:24:30.594701+0000","last_clean":"2024-04-26T02:24:30.594701+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:30.594701+0000","last_undegraded":"2024-04-26T02:24:30.594701+0000","last_fullsized":"2024-04-26T02:24:30.594701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"59'18","reported_seq":172,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594680+0000","last_change":"2024-04-26T02:24:26.592442+0000","last_active":"2024-04-26T02:24:30.594680+0000","last_peered":"2024-04-26T02:24:30.594680+0000","last_clean":"2024-04-26T02:24:30.594680+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:30.594680+0000","last_undegraded":"2024-04-26T02:24:30.594680+0000","last_fullsized":"2024-04-26T02:24:30.594680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.940741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.024896244000000001,"stat_sum":{"num_bytes":2326528,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":10,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.477888+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:33.477888+0000","last_peered":"2024-04-26T02:24:33.477888+0000","last_clean":"2024-04-26T02:24:33.477888+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:33.477888+0000","last_undegraded":"2024-04-26T02:24:33.477888+0000","last_fullsized":"2024-04-26T02:24:33.477888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"59'36","reported_seq":193,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.592933+0000","last_change":"2024-04-26T02:24:26.604225+0000","last_active":"2024-04-26T02:24:29.592933+0000","last_peered":"2024-04-26T02:24:29.592933+0000","last_clean":"2024-04-26T02:24:29.592933+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:29.592933+0000","last_undegraded":"2024-04-26T02:24:29.592933+0000","last_fullsized":"2024-04-26T02:24:29.592933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:11.487019+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.035630457999999997,"stat_sum":{"num_bytes":9289728,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":13208,"num_write":21,"num_write_kb":9568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":81,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:30.594412+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:30.594412+0000","last_peered":"2024-04-26T02:24:30.594412+0000","last_clean":"2024-04-26T02:24:30.594412+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:30.594412+0000","last_undegraded":"2024-04-26T02:24:30.594412+0000","last_fullsized":"2024-04-26T02:24:30.594412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"60'31","reported_seq":189,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.104894+0000","last_change":"2024-04-26T02:24:26.590232+0000","last_active":"2024-04-26T02:24:31.104894+0000","last_peered":"2024-04-26T02:24:31.104894+0000","last_clean":"2024-04-26T02:24:31.104894+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:31.104894+0000","last_undegraded":"2024-04-26T02:24:31.104894+0000","last_fullsized":"2024-04-26T02:24:31.104894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:17.318327+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.024097169000000002,"stat_sum":{"num_bytes":6848512,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":2360,"num_write":22,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.478895+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:33.478895+0000","last_peered":"2024-04-26T02:24:33.478895+0000","last_clean":"2024-04-26T02:24:33.478895+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:33.478895+0000","last_undegraded":"2024-04-26T02:24:33.478895+0000","last_fullsized":"2024-04-26T02:24:33.478895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":148,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.475901+0000","last_change":"2024-04-26T02:24:26.579801+0000","last_active":"2024-04-26T02:24:29.475901+0000","last_peered":"2024-04-26T02:24:29.475901+0000","last_clean":"2024-04-26T02:24:29.475901+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:29.475901+0000","last_undegraded":"2024-04-26T02:24:29.475901+0000","last_fullsized":"2024-04-26T02:24:29.475901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.355461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0084172220000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"3.5","version":"66'53","reported_seq":235,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.497540+0000","last_change":"2024-04-26T02:24:33.499282+0000","last_active":"2024-04-26T02:24:33.497540+0000","last_peered":"2024-04-26T02:24:33.497540+0000","last_clean":"2024-04-26T02:24:33.497540+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:33.497540+0000","last_undegraded":"2024-04-26T02:24:33.497540+0000","last_fullsized":"2024-04-26T02:24:33.497540+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.925123+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.020982924999999999,"stat_sum":{"num_bytes":3473408,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":4831,"num_write":66,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":78,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-04-26T02:24:29.475971+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:29.475971+0000","last_peered":"2024-04-26T02:24:29.475971+0000","last_clean":"2024-04-26T02:24:29.475971+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:29.475971+0000","last_undegraded":"2024-04-26T02:24:29.475971+0000","last_fullsized":"2024-04-26T02:24:29.475971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":156,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.604762+0000","last_change":"2024-04-26T02:24:26.558401+0000","last_active":"2024-04-26T02:24:31.604762+0000","last_peered":"2024-04-26T02:24:31.604762+0000","last_clean":"2024-04-26T02:24:31.604762+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:31.604762+0000","last_undegraded":"2024-04-26T02:24:31.604762+0000","last_fullsized":"2024-04-26T02:24:31.604762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:59.241074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001126724,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.104280+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:31.104280+0000","last_peered":"2024-04-26T02:24:31.104280+0000","last_clean":"2024-04-26T02:24:31.104280+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:31.104280+0000","last_undegraded":"2024-04-26T02:24:31.104280+0000","last_fullsized":"2024-04-26T02:24:31.104280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"67'26","reported_seq":197,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-26T02:24:34.478089+0000","last_change":"2024-04-26T02:24:33.502178+0000","last_active":"2024-04-26T02:24:34.478089+0000","last_peered":"2024-04-26T02:24:34.478089+0000","last_clean":"2024-04-26T02:24:34.478089+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:34.478089+0000","last_undegraded":"2024-04-26T02:24:34.478089+0000","last_fullsized":"2024-04-26T02:24:34.478089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.355849+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.027308189,"stat_sum":{"num_bytes":770048,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":5,"num_read_kb":2,"num_write":9,"num_write_kb":752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":82,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.605970+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:31.605970+0000","last_peered":"2024-04-26T02:24:31.605970+0000","last_clean":"2024-04-26T02:24:31.605970+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:31.605970+0000","last_undegraded":"2024-04-26T02:24:31.605970+0000","last_fullsized":"2024-04-26T02:24:31.605970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"62'56","reported_seq":216,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-04-26T02:24:31.606154+0000","last_change":"2024-04-26T02:24:26.588132+0000","last_active":"2024-04-26T02:24:31.606154+0000","last_peered":"2024-04-26T02:24:31.606154+0000","last_clean":"2024-04-26T02:24:31.606154+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:31.606154+0000","last_undegraded":"2024-04-26T02:24:31.606154+0000","last_fullsized":"2024-04-26T02:24:31.606154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:02.605200+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.031451667000000003,"stat_sum":{"num_bytes":6733824,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":18,"num_read_kb":7113,"num_write":51,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"6","length":"1"},{"start":"b","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":86,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-26T02:24:33.478003+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:33.478003+0000","last_peered":"2024-04-26T02:24:33.478003+0000","last_clean":"2024-04-26T02:24:33.478003+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:33.478003+0000","last_undegraded":"2024-04-26T02:24:33.478003+0000","last_fullsized":"2024-04-26T02:24:33.478003+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":81887232,"num_objects":68,"num_object_clones":21,"num_object_copies":476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":6,"num_read":249,"num_read_kb":56239,"num_write":503,"num_write_kb":88928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":143818752,"data_stored":175169536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":621,"ondisk_log_size":621,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215119,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42440,"kb_used_data":11256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329400,"statfs":{"total":96636764160,"available":96593305600,"internally_reserved":0,"allocated":11526144,"data_stored":15824460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215116,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37780,"kb_used_data":6592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334060,"statfs":{"total":96636764160,"available":96598077440,"internally_reserved":0,"allocated":6750208,"data_stored":7898700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215116,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43204,"kb_used_data":12020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328636,"statfs":{"total":96636764160,"available":96592523264,"internally_reserved":0,"allocated":12308480,"data_stored":14345804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313228,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39564,"kb_used_data":12544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332276,"statfs":{"total":96636764160,"available":96596250624,"internally_reserved":0,"allocated":12845056,"data_stored":13752022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38972,"kb_used_data":7784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332868,"statfs":{"total":96636764160,"available":96596856832,"internally_reserved":0,"allocated":7970816,"data_stored":9313617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280524,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":4624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":4734976,"data_stored":5012817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280525,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41764,"kb_used_data":14740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330076,"statfs":{"total":96636764160,"available":96593997824,"internally_reserved":0,"allocated":15093760,"data_stored":19639633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":10288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":10534912,"data_stored":11937146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34868,"kb_used_data":7848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336972,"statfs":{"total":96636764160,"available":96601059328,"internally_reserved":0,"allocated":8036352,"data_stored":8594810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280523,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38004,"kb_used_data":10976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333836,"statfs":{"total":96636764160,"available":96597848064,"internally_reserved":0,"allocated":11239424,"data_stored":14415226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280523,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36804,"kb_used_data":5624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335036,"statfs":{"total":96636764160,"available":96599076864,"internally_reserved":0,"allocated":5758976,"data_stored":5633946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34476,"kb_used_data":7448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337364,"statfs":{"total":96636764160,"available":96601460736,"internally_reserved":0,"allocated":7626752,"data_stored":9074586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280523,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41804,"kb_used_data":10624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330036,"statfs":{"total":96636764160,"available":96593956864,"internally_reserved":0,"allocated":10878976,"data_stored":14929315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40212,"kb_used_data":13192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331628,"statfs":{"total":96636764160,"available":96595587072,"internally_reserved":0,"allocated":13508608,"data_stored":18101626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33856,"kb_used_data":6828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337984,"statfs":{"total":96636764160,"available":96602095616,"internally_reserved":0,"allocated":6991872,"data_stored":7411066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215116,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45224,"kb_used_data":14036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326616,"statfs":{"total":96636764160,"available":96590454784,"internally_reserved":0,"allocated":14372864,"data_stored":18155084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12759040,"data_stored":14839808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14245888,"data_stored":19173376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7172096,"data_stored":8118272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11915264,"data_stored":13234176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10907648,"data_stored":10948608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4362240,"data_stored":4628480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6230016,"data_stored":8069120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9998336,"data_stored":14442496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5771264,"data_stored":5771264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12644352,"data_stored":17625088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7122944,"data_stored":8847360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":3887104,"data_stored":4546560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":10629120,"data_stored":12591104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":6934528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":9670656,"data_stored":11460608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":10375168,"data_stored":13938688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:35.568 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-04-26T02:24:35.582 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:35.578+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:35.603 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:35.603 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:35.618 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:24:35.684 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:35.684+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:35.785 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:35.779+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:35.788 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:35.788 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:35.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:24:35.885 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:35.879+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:35.925 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:35.925 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:35.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:24:35.987 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:35.983+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:36.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:36.072 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:36.072 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:36.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:24:36.088 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:36.082+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:36.169 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:36.169 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:36.188 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:36.186+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:36.190 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:36.211 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:36.214 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:36.214 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:36.214 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:36.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:24:36.231 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:36.249 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:36.249 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:36.270 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:36.270 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:36.289 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:36.286+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:36.290 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:36.291 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:36.312 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:36.330 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:36.330 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:252 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:36.350 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.275332925000001, 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018057229000000001, 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 252 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071932+0000", 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6830000000000001e-06 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071949+0000", 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.747e-05 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071991+0000", 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1634999999999997e-05 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072017+0000", 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5732999999999999e-05 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072400+0000", 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038336099999999998 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072421+0000", 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1086000000000001e-05 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083152+0000", 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010731001 2024-04-26T02:24:36.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083378+0000", 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022567 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089985+0000", 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00660759 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:253 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.275176940000001, 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018975438000000001, 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 253 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072086+0000", 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5629999999999999e-06 2024-04-26T02:24:36.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072096+0000", 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0586e-05 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072127+0000", 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072144+0000", 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7694e-05 2024-04-26T02:24:36.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072656+0000", 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000511967 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072677+0000", 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0908999999999999e-05 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.084846+0000", 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012169164 2024-04-26T02:24:36.359 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.085079+0000", 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000232613 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.091060+0000", 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059807230000000003 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.360 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:254 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.275082159, 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.02061644, 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 254 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.361 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072180+0000", 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.393e-06 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072190+0000", 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6320000000000003e-06 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072216+0000", 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5667e-05 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072250+0000", 2024-04-26T02:24:36.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4261999999999998e-05 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072786+0000", 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053627299999999998 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072805+0000", 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8787000000000002e-05 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.086864+0000", 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014058795000000001 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.087018+0000", 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000154492 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092795+0000", 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057771389999999997 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:286 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~557056] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.180772+0000", 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.166489501000001, 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014369155999999999, 2024-04-26T02:24:36.366 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 286 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180772+0000", 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180772+0000", 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180775+0000", 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0510000000000001e-06 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181827+0000", 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001052765 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181885+0000", 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7552000000000001e-05 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181910+0000", 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5488000000000001e-05 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.182101+0000", 2024-04-26T02:24:36.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019085 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.182318+0000", 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0002163 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.184300+0000", 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019825419999999999 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186847+0000", 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002547246 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.194976+0000", 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081289740000000006 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195141+0000", 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016438800000000001 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.373 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:287 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~671744] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.160809601, 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20982231300000001, 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 287 2024-04-26T02:24:36.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186454+0000", 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.599e-06 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188135+0000", 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001681297 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188161+0000", 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5639999999999998e-05 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188176+0000", 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4696e-05 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188349+0000", 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000173361 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188599+0000", 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025008099999999998 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190936+0000", 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023371910000000002 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.194810+0000", 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038734189999999999 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396085+0000", 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20127497799999999 2024-04-26T02:24:36.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396274+0000", 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000189051 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:288 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~98304] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.158974866000001, 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.208333828, 2024-04-26T02:24:36.379 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 288 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188288+0000", 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8679999999999999e-06 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188377+0000", 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9355000000000001e-05 2024-04-26T02:24:36.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188412+0000", 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4533000000000003e-05 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188433+0000", 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0662e-05 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.382 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192429+0000", 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039958980000000003 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192696+0000", 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026725799999999998 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.193713+0000", 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001017394 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.383 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196898+0000", 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031851710000000001 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396498+0000", 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.19959943599999999 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.384 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396620+0000", 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012225300000000001 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:289 3.fs0 3:f4c4efcf:::smithi17529564-16:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.385 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.158789771999999, 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.210050292, 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 289 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.386 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188473+0000", 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.387 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188482+0000", 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188514+0000", 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1452999999999999e-05 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188530+0000", 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6079999999999999e-05 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.388 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195465+0000", 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0069355390000000001 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195614+0000", 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149087 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196510+0000", 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089556900000000003 2024-04-26T02:24:36.389 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197757+0000", 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012469650000000001 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398371+0000", 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20061418 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.390 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398522+0000", 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015068199999999999 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:290 3.fs0 3:f4c4efcf:::smithi17529564-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.158706055, 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.212763806, 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.391 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 290 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.392 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188556+0000", 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.437e-06 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188563+0000", 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9630000000000001e-06 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188584+0000", 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0262e-05 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.393 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188603+0000", 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9242999999999999e-05 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196982+0000", 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008379226 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197132+0000", 2024-04-26T02:24:36.394 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149875 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399173+0000", 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.202040675 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399311+0000", 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000138243 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.395 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.401319+0000", 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020078819999999999 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:324 3.fs0 3:fc34d3d4:::smithi17529564-31:head [append 0~0] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.864137678999999, 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015454763999999999, 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.396 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 324 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.397 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483125+0000", 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.849e-06 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483134+0000", 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7809999999999994e-06 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.398 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483153+0000", 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8841000000000001e-05 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483169+0000", 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5739999999999998e-05 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483254+0000", 2024-04-26T02:24:36.399 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5785999999999995e-05 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483262+0000", 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.418e-06 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.486485+0000", 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032228140000000001 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.400 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.486647+0000", 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000162557 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.487943+0000", 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001295488 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.492691+0000", 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047483480000000003 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.401 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498449+0000", 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005757921 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498578+0000", 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000129221 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.402 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:325 3.fs0 3:fc34d3d4:::smithi17529564-31:head [rollback 6] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.864057459000001, 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01566555, 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 325 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.403 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9999999999999997e-07 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.404 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483208+0000", 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9210000000000002e-06 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483218+0000", 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3370000000000006e-06 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483227+0000", 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769999999999994e-06 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.405 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483367+0000", 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014014999999999999 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483382+0000", 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4545999999999999e-05 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.488926+0000", 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005544602 2024-04-26T02:24:36.406 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.489142+0000", 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000215338 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.490131+0000", 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00098933399999999992 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.496700+0000", 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065690790000000002 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.407 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498752+0000", 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020519259999999999 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498869+0000", 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011734 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:326 3.fs0 3:fc34d3d4:::smithi17529564-31:head [append 0~0] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:36.408 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.864019131999999, 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016185303000000002, 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 326 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.409 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.410 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483243+0000", 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483247+0000", 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0450000000000002e-06 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483259+0000", 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2077e-05 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.411 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483268+0000", 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8100000000000004e-06 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483438+0000", 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000170815 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483448+0000", 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7389999999999994e-06 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.412 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.491090+0000", 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076419920000000002 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.491253+0000", 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016303800000000001 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.492098+0000", 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00084462600000000001 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.413 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.496789+0000", 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046916220000000003 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.499227+0000", 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024372529999999999 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.499427+0000", 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000200638 2024-04-26T02:24:36.414 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:331 3.fs0 3:fc34d3d4:::smithi17529564-31:9 [read 0~507904,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483730+0000", 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.863531594000001, 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014531919000000001, 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.415 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 331 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483730+0000", 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483730+0000", 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.416 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483731+0000", 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3069999999999999e-06 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483739+0000", 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1300000000000001e-06 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.417 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483759+0000", 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9811999999999999e-05 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483775+0000", 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6062999999999999e-05 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484068+0000", 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029358599999999998 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.418 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484088+0000", 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9213000000000001e-05 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.491377+0000", 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072898549999999996 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.491695+0000", 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00031801600000000001 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.419 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498261+0000", 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006565937 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:332 3.cs0 3:3fb4b57b:::smithi17529564-46:head [append 0~0] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.863451048999998, 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014564338, 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.420 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 332 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.421 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483812+0000", 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4559999999999999e-06 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483819+0000", 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2200000000000003e-06 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483840+0000", 2024-04-26T02:24:36.422 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1665999999999999e-05 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483856+0000", 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5270000000000001e-05 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484001+0000", 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014564600000000001 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:36.423 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484024+0000", 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2875999999999999e-05 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488065+0000", 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040404899999999999 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488246+0000", 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181788 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.424 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489812+0000", 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001565823 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497402+0000", 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075900050000000004 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498113+0000", 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00071069199999999996 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.425 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498374+0000", 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000261406 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:333 3.cs0 3:3fb4b57b:::smithi17529564-46:head [rollback 6] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.863374107999999, 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015996089000000002, 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.426 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 333 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.427 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483888+0000", 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.367e-06 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483895+0000", 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0859999999999996e-06 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.428 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483918+0000", 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2926e-05 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483933+0000", 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5073e-05 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484094+0000", 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000161003 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.429 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484112+0000", 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7808999999999998e-05 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.491940+0000", 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078274620000000003 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.492202+0000", 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026212700000000002 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.430 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.493787+0000", 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001585562 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497739+0000", 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003951319 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.499764+0000", 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020257140000000001 2024-04-26T02:24:36.431 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.499883+0000", 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118641 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:334 3.cs0 3:3fb4b57b:::smithi17529564-46:head [append 0~0] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.863280029999999, 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016347856000000001, 2024-04-26T02:24:36.432 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 334 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.433 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483982+0000", 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483987+0000", 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7589999999999997e-06 2024-04-26T02:24:36.434 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484006+0000", 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9117e-05 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484027+0000", 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0922000000000001e-05 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484169+0000", 2024-04-26T02:24:36.435 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014197999999999999 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484178+0000", 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3260000000000002e-06 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494927+0000", 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010748627 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.436 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.495181+0000", 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025385000000000002 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.496382+0000", 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001201793 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498738+0000", 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002355359 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.437 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.500202+0000", 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001464676 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.500329+0000", 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012651700000000001 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.438 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:370 3.cs0 3:384aaf8b:::smithi17529564-13:head [append 0~688128] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.479889+0000", 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.867371703, 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015547561999999999, 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 370 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.439 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.479889+0000", 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.479889+0000", 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.479891+0000", 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9010000000000001e-06 2024-04-26T02:24:36.440 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.480974+0000", 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001082614 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.480989+0000", 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5247e-05 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.441 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.480998+0000", 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4610000000000008e-06 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.481051+0000", 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000002e-05 2024-04-26T02:24:36.442 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.481057+0000", 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3929999999999999e-06 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.483952+0000", 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028956089999999999 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.484017+0000", 2024-04-26T02:24:36.443 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5217999999999998e-05 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.485226+0000", 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012085900000000001 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.486395+0000", 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001168526 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.444 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495340+0000", 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089451429999999992 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495437+0000", 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7260000000000001e-05 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:372 3.cs0 3:384aaf8b:::smithi17529564-13:head [append 0~229376] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.495074+0000", 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.852187383, 2024-04-26T02:24:36.445 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013059873, 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 372 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.446 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495074+0000", 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495074+0000", 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495075+0000", 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1500000000000003e-07 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.447 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495312+0000", 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023730999999999999 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495323+0000", 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1311000000000001e-05 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495331+0000", 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5240000000000003e-06 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.448 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495494+0000", 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000163702 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495577+0000", 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2805000000000004e-05 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.496170+0000", 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00059234800000000003 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.449 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.497936+0000", 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001766093 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508086+0000", 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010150635 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508134+0000", 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7330000000000003e-05 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.450 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:373 3.cs0 3:384aaf8b:::smithi17529564-13:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.495344+0000", 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.851916762, 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012986271000000001, 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 373 2024-04-26T02:24:36.451 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495344+0000", 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495344+0000", 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495345+0000", 2024-04-26T02:24:36.452 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.06e-07 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495347+0000", 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2050000000000001e-06 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495352+0000", 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3669999999999996e-06 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.453 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495356+0000", 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3230000000000002e-06 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.496738+0000", 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013820729999999999 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.496869+0000", 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000130798 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.454 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.497477+0000", 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060864800000000004 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.498958+0000", 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001480859 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508267+0000", 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093085140000000004 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.455 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508331+0000", 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3978000000000003e-05 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:374 3.cs0 3:384aaf8b:::smithi17529564-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.851897594, 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015685046000000001, 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:36.456 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 374 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.457 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1699999999999999e-07 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495365+0000", 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5409999999999999e-06 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495371+0000", 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1440000000000002e-06 2024-04-26T02:24:36.458 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495374+0000", 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.117e-06 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.498312+0000", 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002938726 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.498395+0000", 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2406999999999999e-05 2024-04-26T02:24:36.459 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508720+0000", 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010324804 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508807+0000", 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7645000000000005e-05 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.511049+0000", 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022413450000000001 2024-04-26T02:24:36.460 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:377 3.cs0 3:3fb4b57b:::smithi17529564-46:head [read 0~3096576,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.495484+0000", 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 13.851776732999999, 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014842746, 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:36.461 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 377 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495484+0000", 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495484+0000", 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.462 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495485+0000", 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3300000000000001e-07 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495493+0000", 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9030000000000004e-06 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495497+0000", 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7400000000000004e-06 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.463 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495500+0000", 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1530000000000001e-06 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.501071+0000", 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055707830000000002 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.501129+0000", 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7989999999999999e-05 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.464 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.510327+0000", 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0091979439999999996 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.465 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:36.466 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:36.466 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:36.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:24:36.468 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:36.469 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:36.469 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:36.470 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:36.470 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:36.468+0000 7f68ead75640 0 -- 172.21.15.59:0/3159041810 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f68e4223b20 msgr2=0x7f68e4225f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-04-26T02:24:36.472 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:36.463+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:36.479 INFO:tasks.rados.rados.0.smithi175.stdout:222: done (0 left) 2024-04-26T02:24:36.479 INFO:tasks.rados.rados.0.smithi175.stdout:223: snap_remove snap 20 2024-04-26T02:24:36.493 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:36.493 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:36.567 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:36.564+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:36.608 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:36.608 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:36.608 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:36.608 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:36.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:24:36.668 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:36.666+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:36.769 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:36.766+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:36.797 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:36.797 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:36.797 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:36.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:24:36.870 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:36.868+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:36.935 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:36.935 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:36.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:36.935 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:36.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.935 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 37/31 ECSubWrite(tid=33, reqid=osd.13.0:30, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:36.935 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.879940048999998, 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060489920000000004, 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:36.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052112+0000", 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1500000000000004e-07 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052123+0000", 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0360000000000001e-05 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.937 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052133+0000", 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052143+0000", 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7319999999999993e-06 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052254+0000", 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011064 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.052264+0000", 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0154e-05 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058071+0000", 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058070220000000002 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058161+0000", 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9919000000000004e-05 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 38/31 ECSubWrite(tid=50, reqid=osd.12.0:48, at_version=0'0, trim_to=0'0, roll_forward_to=38'21))", 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:06.053544+0000", 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.878507251999999, 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063140849999999997, 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053544+0000", 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053544+0000", 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053546+0000", 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.068e-06 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053565+0000", 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9054000000000001e-05 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053587+0000", 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2215999999999999e-05 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053601+0000", 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4548e-05 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053706+0000", 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104675 2024-04-26T02:24:36.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.053724+0000", 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7558999999999999e-05 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.059795+0000", 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060717690000000003 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:06.059859+0000", 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3195999999999996e-05 2024-04-26T02:24:36.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 55/31 ECSubWrite(tid=91, reqid=client.4589.0:378, at_version=0'0, trim_to=0'0, roll_forward_to=55'33))", 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.396935761, 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065763030000000004, 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535117+0000", 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.017e-06 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535132+0000", 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5427999999999999e-05 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535149+0000", 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6558e-05 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535156+0000", 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5930000000000002e-06 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535242+0000", 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6868999999999998e-05 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535251+0000", 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1200000000000002e-06 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.541609+0000", 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063584030000000003 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.541692+0000", 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3314999999999998e-05 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.bs5 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.372028905000001, 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080201519999999991, 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.948 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.03e-07 2024-04-26T02:24:36.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560055+0000", 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2001000000000001e-05 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560107+0000", 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1989e-05 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560123+0000", 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5603e-05 2024-04-26T02:24:36.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560425+0000", 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030192899999999999 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560439+0000", 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4446e-05 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.567967+0000", 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075278330000000003 2024-04-26T02:24:36.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568043+0000", 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6048000000000001e-05 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 59/31 ECSubWrite(tid=77, reqid=osd.13.0:77, at_version=59'24, trim_to=0'0, roll_forward_to=58'22))", 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.370928495999999, 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074306329999999999, 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.952 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561124+0000", 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.15e-07 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561159+0000", 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5326e-05 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561175+0000", 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6483000000000001e-05 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561190+0000", 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4626e-05 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561367+0000", 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000176696 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561394+0000", 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6991999999999998e-05 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568489+0000", 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070955460000000003 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568554+0000", 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4648999999999997e-05 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.370825086, 2024-04-26T02:24:36.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074280149999999996, 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4700000000000001e-07 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561250+0000", 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2586999999999999e-05 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561267+0000", 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7241e-05 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561278+0000", 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0586e-05 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561388+0000", 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000110166 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561400+0000", 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2553e-05 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568602+0000", 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072020119999999998 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568655+0000", 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2222999999999998e-05 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.2s3 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:24:36.960 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.578849+0000", 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.353202569, 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064147859999999996, 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.578849+0000", 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.578849+0000", 2024-04-26T02:24:36.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.578850+0000", 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.288e-06 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.578900+0000", 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9311000000000003e-05 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.578918+0000", 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7983e-05 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.578930+0000", 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2444e-05 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579067+0000", 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013634000000000001 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579081+0000", 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4297000000000001e-05 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.585206+0000", 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061248429999999996 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.585264+0000", 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8279999999999998e-05 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.bs5 59/31 ECSubWrite(tid=32, reqid=osd.7.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=59'21))", 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.352393087999999, 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089319410000000005, 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579660+0000", 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2020000000000001e-06 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579676+0000", 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6146000000000001e-05 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579695+0000", 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8970999999999998e-05 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579707+0000", 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2024e-05 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579829+0000", 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000122459 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579843+0000", 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3869000000000001e-05 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588534+0000", 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086902950000000007 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588591+0000", 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6975000000000003e-05 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.968 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.0s2 59/31 ECSubWrite(tid=38, reqid=osd.1.0:37, at_version=0'0, trim_to=0'0, roll_forward_to=59'25))", 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.344321666999999, 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076262750000000001, 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:24:36.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587731+0000", 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1620000000000001e-06 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587749+0000", 2024-04-26T02:24:36.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.791e-05 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587768+0000", 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8657000000000001e-05 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587780+0000", 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2398000000000001e-05 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587901+0000", 2024-04-26T02:24:36.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000121264 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587916+0000", 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4396000000000001e-05 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595298+0000", 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073817470000000001 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595356+0000", 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8740999999999999e-05 2024-04-26T02:24:36.972 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 59/31 ECSubWrite(tid=137, reqid=osd.12.0:134, at_version=0'0, trim_to=0'0, roll_forward_to=59'52))", 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.343462229, 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068257600000000002, 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588590+0000", 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2500000000000004e-07 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588606+0000", 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6001000000000001e-05 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588623+0000", 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6481999999999999e-05 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588635+0000", 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2481e-05 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588726+0000", 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0257e-05 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588738+0000", 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1917e-05 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595365+0000", 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006627473 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.976 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595415+0000", 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0223999999999999e-05 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.2s3 59/31 ECSubWrite(tid=20, reqid=osd.14.0:19, at_version=0'0, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.340740914, 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095002379999999994, 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.977 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591312+0000", 2024-04-26T02:24:36.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.13e-06 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591326+0000", 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4403000000000001e-05 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591342+0000", 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5957999999999999e-05 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591354+0000", 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.184e-05 2024-04-26T02:24:36.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591427+0000", 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2700000000000005e-05 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591437+0000", 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.049e-05 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600754+0000", 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093168859999999999 2024-04-26T02:24:36.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600811+0000", 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6830999999999998e-05 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 59/31 ECSubWrite(tid=47, reqid=osd.11.0:47, at_version=59'36, trim_to=0'0, roll_forward_to=58'32))", 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.340394292999999, 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0091052600000000004, 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.981 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591658+0000", 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7199999999999998e-07 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591690+0000", 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1347999999999999e-05 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591703+0000", 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3095000000000001e-05 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591709+0000", 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591781+0000", 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1532000000000006e-05 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591793+0000", 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1997000000000001e-05 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600686+0000", 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088932439999999998 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600763+0000", 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6503999999999998e-05 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 60/31 ECSubWrite(tid=138, reqid=client.4589.0:507, at_version=60'54, trim_to=0'0, roll_forward_to=59'52))", 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 9.4572774549999998, 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067090819999999999, 2024-04-26T02:24:36.985 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474775+0000", 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474962+0000", 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018722500000000001 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474997+0000", 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4761999999999997e-05 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475015+0000", 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8153000000000001e-05 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475211+0000", 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000196627 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475224+0000", 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2748999999999999e-05 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481434+0000", 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062096260000000002 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481483+0000", 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9500999999999999e-05 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.0s2 66/31 ECSubWrite(tid=48, reqid=osd.1.0:48, at_version=66'35, trim_to=0'0, roll_forward_to=65'33))", 2024-04-26T02:24:36.989 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.462064512, 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070263529999999999, 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:24:36.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469988+0000", 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0200000000000002e-07 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470012+0000", 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4773000000000002e-05 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470027+0000", 2024-04-26T02:24:36.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4894e-05 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470038+0000", 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0991e-05 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471109+0000", 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010704569999999999 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471119+0000", 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0332999999999999e-05 2024-04-26T02:24:36.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476959+0000", 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058394240000000002 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477014+0000", 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4979000000000003e-05 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.993 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 66/31 ECSubWrite(tid=143, reqid=osd.12.0:143, at_version=66'50, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470003+0000", 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.4620486559999999, 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055463320000000002, 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470003+0000", 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470003+0000", 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470003+0000", 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.96e-07 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470031+0000", 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7197999999999999e-05 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:36.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470041+0000", 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0047000000000001e-05 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470048+0000", 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1890000000000001e-06 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470522+0000", 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00047402499999999999 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470533+0000", 2024-04-26T02:24:36.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1296e-05 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.475504+0000", 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0049704229999999999 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.475549+0000", 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5757999999999998e-05 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.4619782130000001, 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007325079, 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470115+0000", 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1431999999999999e-05 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:36.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470129+0000", 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3824e-05 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470138+0000", 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2439999999999999e-06 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471106+0000", 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00096715899999999999 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471117+0000", 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1871999999999999e-05 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477371+0000", 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062540130000000001 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477399+0000", 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.711e-05 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.461659026, 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065435570000000002, 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470394+0000", 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.083e-06 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470435+0000", 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0899000000000003e-05 2024-04-26T02:24:37.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470451+0000", 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6701000000000002e-05 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470465+0000", 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3946e-05 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471113+0000", 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00064768499999999995 2024-04-26T02:24:37.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471119+0000", 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7379999999999999e-06 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476885+0000", 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057667029999999998 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476936+0000", 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0801999999999999e-05 2024-04-26T02:24:37.005 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.2s3 66/31 ECSubWrite(tid=21, reqid=osd.14.0:21, at_version=66'20, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.481236+0000", 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.4508160330000002, 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055994560000000001, 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481236+0000", 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481236+0000", 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481236+0000", 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.39e-07 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481262+0000", 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5761e-05 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481309+0000", 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6937999999999997e-05 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481319+0000", 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0716999999999999e-05 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481421+0000", 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010127 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481431+0000", 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.9969999999999993e-06 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.486797+0000", 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053661589999999997 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.486835+0000", 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8275000000000002e-05 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 66/31 ECSubWrite(tid=87, reqid=osd.13.0:87, at_version=66'26, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.481376+0000", 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.4506758940000002, 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058773269999999999, 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.010 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481376+0000", 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481376+0000", 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481376+0000", 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.8099999999999998e-07 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481402+0000", 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5435e-05 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481415+0000", 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2918000000000001e-05 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481426+0000", 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.145e-05 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481518+0000", 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2114000000000006e-05 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.481527+0000", 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0880000000000001e-06 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.487213+0000", 2024-04-26T02:24:37.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0056862270000000003 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.487253+0000", 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9714e-05 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 3.4382154250000001, 2024-04-26T02:24:37.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076064669999999996, 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493837+0000", 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0049999999999999e-06 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493868+0000", 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0499999999999999e-05 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493883+0000", 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5404e-05 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493894+0000", 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.094e-05 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.494065+0000", 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017112299999999999 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.494077+0000", 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1402e-05 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.501400+0000", 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073234449999999996 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.501443+0000", 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2648000000000002e-05 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.018 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:37.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:24:37.020 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:37.019+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:37.121 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:37.119+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:37.194 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:37.195 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:37.195 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:37.195 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:37.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:24:37.221 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:37.219+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:37.322 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:37.318+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:37.373 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:37.373 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:37.374 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:37.374 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:37.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:24:37.423 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:37.422+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:37.471 INFO:tasks.rados.rados.0.smithi175.stdout:223: done (0 left) 2024-04-26T02:24:37.471 INFO:tasks.rados.rados.0.smithi175.stdout:224: delete oid 39 current snap is 21 2024-04-26T02:24:37.485 INFO:tasks.rados.rados.0.smithi175.stdout:224: done (0 left) 2024-04-26T02:24:37.485 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 25 current snap is 21 2024-04-26T02:24:37.485 INFO:tasks.rados.rados.0.smithi175.stdout:225: seq_num 115 ranges {4587520=770048,5357568=704512,6062080=458752} 2024-04-26T02:24:37.518 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:37.518 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:197 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~589824] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.458023570999998, 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01132682, 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 197 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.519 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058678+0000", 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1119999999999999e-06 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059820+0000", 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011419329999999999 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059838+0000", 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7312e-05 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059849+0000", 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1066999999999999e-05 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060084+0000", 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023474499999999999 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060231+0000", 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014785699999999999 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061250+0000", 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00101822 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.063642+0000", 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00239267 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069912+0000", 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006269546 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070003+0000", 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1358000000000002e-05 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:200 3.5s0 3:a5f188bf:::smithi17529564-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.451867903, 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094044490000000005, 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.524 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 200 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7700000000000005e-07 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064835+0000", 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6929999999999999e-06 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064844+0000", 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1919999999999994e-06 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064850+0000", 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0610000000000001e-06 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068037+0000", 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031864490000000001 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068091+0000", 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4273e-05 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072664+0000", 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004572932 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072801+0000", 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013716100000000001 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.074236+0000", 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001435211 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:255 3.5s0 3:a9520d7f:::smithi17529564-15:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.071948+0000", 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.444751610000001, 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087410590000000007, 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 255 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071948+0000", 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071948+0000", 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071951+0000", 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6469999999999998e-06 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071963+0000", 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2516e-05 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071996+0000", 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2054999999999997e-05 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072017+0000", 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1263999999999998e-05 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.073247+0000", 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001230678 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.073535+0000", 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028712799999999999 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.075011+0000", 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014760649999999999 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.077188+0000", 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002177567 2024-04-26T02:24:37.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.080453+0000", 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032644029999999999 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.080689+0000", 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000236736 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:266 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.383405145000001, 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015257379, 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 266 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133296+0000", 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.313e-06 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133306+0000", 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4469999999999995e-06 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133328+0000", 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2439e-05 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133371+0000", 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2571999999999998e-05 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.141874+0000", 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085034459999999996 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142095+0000", 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000220996 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.148552+0000", 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064571660000000003 2024-04-26T02:24:37.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:281 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~524288] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.347768445, 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019327321000000001, 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 281 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168934+0000", 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4839999999999998e-06 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170027+0000", 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010934390000000001 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170064+0000", 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6295999999999999e-05 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170083+0000", 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8958999999999999e-05 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170253+0000", 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017040499999999999 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170531+0000", 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027794499999999998 2024-04-26T02:24:37.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.172686+0000", 2024-04-26T02:24:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021548629999999999 2024-04-26T02:24:37.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174338+0000", 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00165226 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188107+0000", 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013769366999999999 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188259+0000", 2024-04-26T02:24:37.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015130300000000001 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:282 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~524288] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.343416715, 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015341766, 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.545 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 282 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173286+0000", 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3700000000000002e-06 2024-04-26T02:24:37.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174448+0000", 2024-04-26T02:24:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011628610000000001 2024-04-26T02:24:37.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174480+0000", 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1356000000000003e-05 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174494+0000", 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4462e-05 2024-04-26T02:24:37.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174626+0000", 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000132216 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174882+0000", 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000255429 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.176676+0000", 2024-04-26T02:24:37.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017945190000000001 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186967+0000", 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010290597 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188445+0000", 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001478441 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188625+0000", 2024-04-26T02:24:37.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017951499999999999 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:283 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~245760] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.341700751000001, 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014380792, 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.552 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 283 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175001+0000", 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1840000000000002e-06 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175369+0000", 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000367525 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175391+0000", 2024-04-26T02:24:37.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2149000000000001e-05 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175404+0000", 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3293e-05 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178383+0000", 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029786449999999998 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178546+0000", 2024-04-26T02:24:37.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016274200000000001 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180029+0000", 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014829209999999999 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187286+0000", 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072569109999999996 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.189276+0000", 2024-04-26T02:24:37.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019904459999999999 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.189380+0000", 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103976 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:284 3.5s0 3:a5f188bf:::smithi17529564-38:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.341270699999999, 2024-04-26T02:24:37.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014822755, 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 284 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175430+0000", 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2500000000000001e-06 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175437+0000", 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7429999999999996e-06 2024-04-26T02:24:37.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175449+0000", 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1426e-05 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175457+0000", 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4130000000000006e-06 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181434+0000", 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059764500000000003 2024-04-26T02:24:37.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181694+0000", 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026069800000000002 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186398+0000", 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047033689999999998 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187751+0000", 2024-04-26T02:24:37.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013529480000000001 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190099+0000", 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023486190000000001 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190252+0000", 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015283899999999999 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:285 3.5s0 3:a5f188bf:::smithi17529564-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.341230402000001, 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019577975000000001, 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 285 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6700000000000003e-07 2024-04-26T02:24:37.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175496+0000", 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5456000000000002e-05 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175509+0000", 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3039e-05 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175521+0000", 2024-04-26T02:24:37.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2597e-05 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190996+0000", 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015474141 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.191226+0000", 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023018999999999999 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195047+0000", 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038217849999999999 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.178628+0000", 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.338072358000002, 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085186810000000002, 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.567 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178628+0000", 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178628+0000", 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178629+0000", 2024-04-26T02:24:37.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.64e-06 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178638+0000", 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5599999999999994e-06 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178661+0000", 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3442e-05 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178675+0000", 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3482000000000001e-05 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187091+0000", 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084160720000000001 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187146+0000", 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5485000000000002e-05 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=50, last_complete=42'38, committed=1, applied=1))", 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179477+0000", 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.337222960999998, 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088159789999999998, 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179477+0000", 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179477+0000", 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179479+0000", 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7799999999999999e-06 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179490+0000", 2024-04-26T02:24:37.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1539000000000001e-05 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179520+0000", 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9879e-05 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179540+0000", 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9979999999999998e-05 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187823+0000", 2024-04-26T02:24:37.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0082831750000000003 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188293+0000", 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00046962600000000001 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.337127990999999, 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.009074291, 2024-04-26T02:24:37.574 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.575 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179573+0000", 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179579+0000", 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5030000000000002e-06 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179612+0000", 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3361999999999997e-05 2024-04-26T02:24:37.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179631+0000", 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.819e-05 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188340+0000", 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087091149999999999 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188646+0000", 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030643400000000001 2024-04-26T02:24:37.577 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:368 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.462456+0000", 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.054243433, 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089918250000000002, 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.578 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 368 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462456+0000", 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462456+0000", 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462457+0000", 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9299999999999997e-07 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462464+0000", 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6189999999999996e-06 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462475+0000", 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0817e-05 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462482+0000", 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3100000000000003e-06 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462669+0000", 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018740400000000001 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462679+0000", 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3819999999999993e-06 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.468464+0000", 2024-04-26T02:24:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057856560000000001 2024-04-26T02:24:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.468521+0000", 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7077999999999998e-05 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.471448+0000", 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029268660000000002 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:369 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.462494+0000", 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.054205568, 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094557310000000002, 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 369 2024-04-26T02:24:37.584 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462494+0000", 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462494+0000", 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462495+0000", 2024-04-26T02:24:37.585 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0100000000000005e-07 2024-04-26T02:24:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462499+0000", 2024-04-26T02:24:37.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6430000000000001e-06 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462507+0000", 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3979999999999999e-06 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462514+0000", 2024-04-26T02:24:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.764e-06 2024-04-26T02:24:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462719+0000", 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020476000000000001 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462727+0000", 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.541e-06 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.469121+0000", 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063935870000000001 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.469207+0000", 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6071999999999999e-05 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.471950+0000", 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027433650000000002 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.590 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:384 3.5s0 3:a9520d7f:::smithi17529564-15:head [copy-from ver 2] snapc d=[d,c,6] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.724466+0000", 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.792234175000001, 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012639683000000001, 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 384 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724466+0000", 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724466+0000", 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724467+0000", 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7599999999999996e-07 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724473+0000", 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.066e-06 2024-04-26T02:24:37.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724481+0000", 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9759999999999995e-06 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724487+0000", 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.054e-06 2024-04-26T02:24:37.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724545+0000", 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8729e-05 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724619+0000", 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3738000000000004e-05 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.732395+0000", 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077759489999999999 2024-04-26T02:24:37.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733725+0000", 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013303449999999999 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.737016+0000", 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032903089999999999 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.737105+0000", 2024-04-26T02:24:37.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9641000000000005e-05 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:385 3.5s0 3:a9520d7f:::smithi17529564-15:head [stat] snapc 0=[] RETRY=1 ondisk+retry+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.724504+0000", 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.792196005999999, 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088710479999999994, 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.597 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 385 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724504+0000", 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724504+0000", 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724505+0000", 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0100000000000005e-07 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724508+0000", 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7510000000000002e-06 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724516+0000", 2024-04-26T02:24:37.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8469999999999996e-06 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724522+0000", 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1929999999999998e-06 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.601 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724742+0000", 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021985200000000001 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724775+0000", 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2981999999999997e-05 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733229+0000", 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084534899999999993 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.602 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733300+0000", 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1721e-05 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733375+0000", 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4610999999999994e-05 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.603 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:417 3.5s0 3:a9520d7f:::smithi17529564-15:head [append 0~442368] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.823567+0000", 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.693132888999999, 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011059009, 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 417 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.823567+0000", 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.823567+0000", 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.823569+0000", 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.261e-06 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824243+0000", 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00067331699999999999 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824266+0000", 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3365000000000001e-05 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824277+0000", 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1487e-05 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824376+0000", 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8072000000000006e-05 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824507+0000", 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131605 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.825462+0000", 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00095479099999999997 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.826745+0000", 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001283113 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.834529+0000", 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077834990000000001 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.834626+0000", 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7498999999999996e-05 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.608 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:426 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.831912+0000", 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.684787658999999, 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087714500000000001, 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:37.609 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 426 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.831912+0000", 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.831912+0000", 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.831913+0000", 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1800000000000001e-07 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.831915+0000", 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7520000000000001e-06 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.831922+0000", 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3620000000000002e-06 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.831927+0000", 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2329999999999997e-06 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.839024+0000", 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070970909999999998 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.839121+0000", 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6735000000000001e-05 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.612 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.840684+0000", 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001562859 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds4 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470039+0000", 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.0466606220000001, 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0092041320000000003, 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.613 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470039+0000", 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470039+0000", 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.614 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470040+0000", 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1199999999999999e-07 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470060+0000", 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0832e-05 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470069+0000", 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4400000000000005e-06 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.615 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470075+0000", 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-06 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470752+0000", 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00067646600000000002 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470770+0000", 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8634000000000002e-05 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.616 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479195+0000", 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084242290000000001 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479243+0000", 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8739000000000002e-05 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as6 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:37.617 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 4.046408252, 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089483679999999999, 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:37.618 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4000000000000001e-07 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470343+0000", 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0643000000000003e-05 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470364+0000", 2024-04-26T02:24:37.619 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1107999999999998e-05 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470370+0000", 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0349999999999998e-06 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470993+0000", 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00062319199999999995 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471005+0000", 2024-04-26T02:24:37.620 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1173e-05 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479167+0000", 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081628959999999993 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479240+0000", 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2581000000000002e-05 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:37.621 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:37.622 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:37.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:225: writing smithi17529564-25 from 4587520 to 5357568 tid 1 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:225: writing smithi17529564-25 from 5357568 to 6062080 tid 2 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:225: writing smithi17529564-25 from 6062080 to 6520832 tid 3 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:226: read oid 13 snap -1 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:226: expect (ObjNum 86 snap 12 seq_num 86) 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:227: setattr oid 5 current snap is 21 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:228: rollback oid 39 current snap is 21 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 39 to 17 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:229: rollback oid 4 current snap is 21 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 4 to 16 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 19 current snap is 21 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:230: seq_num 116 ranges {311296=786432,1097728=458752,1556480=442368,1998848=262144} 2024-04-26T02:24:37.626 INFO:tasks.rados.rados.0.smithi175.stdout:230: writing smithi17529564-19 from 311296 to 1097728 tid 1 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:230: writing smithi17529564-19 from 1097728 to 1556480 tid 2 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:230: writing smithi17529564-19 from 1556480 to 1998848 tid 3 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:230: writing smithi17529564-19 from 1998848 to 2260992 tid 4 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:231: rmattr oid 20 current snap is 21 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:225: finishing write tid 1 to smithi17529564-25 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:225: finishing write tid 2 to smithi17529564-25 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:225: finishing write tid 3 to smithi17529564-25 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:225: finishing write tid 4 to smithi17529564-25 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:229: finishing rollback tid 0 to smithi17529564-4 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:228: finishing rollback tid 1 to smithi17529564-39 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:228: finishing rollback tid 2 to smithi17529564-39 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 39 v 50 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:229: finishing rollback tid 1 to smithi17529564-4 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:229: finishing rollback tid 2 to smithi17529564-4 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 56 (ObjNum 81 snap 7 seq_num 81) dirty exists 2024-04-26T02:24:37.627 INFO:tasks.rados.rados.0.smithi175.stdout:225: finishing write tid 5 to smithi17529564-25 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:225: oid 25 updating version 0 to 62 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:225: oid 25 updating version 62 to 63 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:225: oid 25 version 63 is already newer than 60 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:225: oid 25 version 63 is already newer than 61 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 25 v 63 (ObjNum 115 snap 21 seq_num 115) dirty exists 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:225: left oid 25 (ObjNum 115 snap 21 seq_num 115) 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:225: done (6 left) 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:228: done (5 left) 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:229: done (4 left) 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:232: snap_create 2024-04-26T02:24:37.628 INFO:tasks.rados.rados.0.smithi175.stdout:226: expect (ObjNum 86 snap 12 seq_num 86) 2024-04-26T02:24:37.629 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:37.619+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:37.646 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 5 v 45 (ObjNum 289 snap 0 seq_num 1) dirty exists 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 20 v 27 (ObjNum 289 snap 0 seq_num 0) dirty exists 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: finishing write tid 1 to smithi17529564-19 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: finishing write tid 2 to smithi17529564-19 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: finishing write tid 3 to smithi17529564-19 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: finishing write tid 4 to smithi17529564-19 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: finishing write tid 5 to smithi17529564-19 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: finishing write tid 6 to smithi17529564-19 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: oid 19 updating version 0 to 32 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: oid 19 version 32 is already newer than 31 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: oid 19 version 32 is already newer than 28 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: oid 19 version 32 is already newer than 29 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: oid 19 version 32 is already newer than 30 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 19 v 32 (ObjNum 116 snap 21 seq_num 116) dirty exists 2024-04-26T02:24:37.647 INFO:tasks.rados.rados.0.smithi175.stdout:230: left oid 19 (ObjNum 116 snap 21 seq_num 116) 2024-04-26T02:24:37.724 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:37.723+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:37.759 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:37.759 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:37.759 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:37.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:24:37.825 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:37.823+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:37.896 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:37.896 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:37.896 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:37.912 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:24:37.926 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:37.926+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:38.027 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:38.026+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:38.043 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.998907521, 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070939660000000002, 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040633+0000", 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040634+0000", 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1800000000000005e-07 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040658+0000", 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3377999999999999e-05 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040673+0000", 2024-04-26T02:24:38.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5376999999999999e-05 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040683+0000", 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0446e-05 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040733+0000", 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0002e-05 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.040740+0000", 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2210000000000002e-06 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047581+0000", 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068417319999999997 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.047727+0000", 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014599200000000001 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:201 3.ds0 3:bba78641:::smithi17529564-30:head [stat,delete] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 32.974934519000001, 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006036591, 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 201 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.048 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064606+0000", 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064608+0000", 2024-04-26T02:24:38.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.826e-06 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064617+0000", 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8799999999999997e-06 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064634+0000", 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6495999999999999e-05 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064641+0000", 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8520000000000004e-06 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064728+0000", 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6112999999999994e-05 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064856+0000", 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000128734 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.065756+0000", 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089999800000000005 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.067196+0000", 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014399969999999999 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070552+0000", 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033559589999999999 2024-04-26T02:24:38.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070643+0000", 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0736000000000007e-05 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:256 3.as0 3:5c6c7353:::smithi17529564-29:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.958405396, 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014402701, 2024-04-26T02:24:38.053 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 256 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081140+0000", 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2930000000000002e-06 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081191+0000", 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1569e-05 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081233+0000", 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2070999999999998e-05 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081259+0000", 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5570000000000001e-05 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081495+0000", 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000236269 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081510+0000", 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4593000000000001e-05 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089249+0000", 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077387760000000002 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089530+0000", 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028140800000000003 2024-04-26T02:24:38.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.091455+0000", 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001924947 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.093895+0000", 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002439662 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.095340+0000", 2024-04-26T02:24:38.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001445436 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.095538+0000", 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019810699999999999 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 48/31 ECSubWrite(tid=39, reqid=osd.15.0:38, at_version=0'0, trim_to=0'0, roll_forward_to=48'28))", 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.513902+0000", 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 22.525638725, 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060962789999999996, 2024-04-26T02:24:38.059 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513902+0000", 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513902+0000", 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.060 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513903+0000", 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1699999999999997e-07 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513914+0000", 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1537e-05 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513927+0000", 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2099000000000001e-05 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.061 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513934+0000", 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4610000000000002e-06 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513984+0000", 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9975000000000002e-05 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.513993+0000", 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7590000000000003e-06 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.062 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.519938+0000", 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005944881 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.519998+0000", 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0850000000000002e-05 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:378 3.as0 3:5a9c887b:::smithi17529564-26:head [append 0~704512] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:38.063 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.526111+0000", 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.513430255999999, 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088302729999999996, 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 378 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.526111+0000", 2024-04-26T02:24:38.064 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.526111+0000", 2024-04-26T02:24:38.065 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.526113+0000", 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4899999999999999e-06 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.527290+0000", 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011765739999999999 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.067 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.527332+0000", 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2456000000000001e-05 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.527351+0000", 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8793000000000001e-05 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.527469+0000", 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118309 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.068 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.527572+0000", 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010267099999999999 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.529313+0000", 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001740777 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.531951+0000", 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026378970000000002 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.069 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.534861+0000", 2024-04-26T02:24:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029107159999999998 2024-04-26T02:24:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.070 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.534941+0000", 2024-04-26T02:24:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9590000000000002e-05 2024-04-26T02:24:38.071 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:379 3.as0 3:5a9c887b:::smithi17529564-26:head [append 0~688128] snapc d=[d,c,6] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:38.072 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.537828+0000", 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.501713087000001, 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089663, 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 379 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.073 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.537828+0000", 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.537828+0000", 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.074 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.537829+0000", 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1459999999999999e-06 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538378+0000", 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00054909800000000003 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538400+0000", 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1965999999999999e-05 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.075 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538413+0000", 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.306e-05 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538484+0000", 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0735000000000006e-05 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538564+0000", 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0236999999999998e-05 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.076 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.539459+0000", 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089462799999999996 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.545566+0000", 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061076409999999996 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.546575+0000", 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010086800000000001 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.077 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.546794+0000", 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021910899999999999 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:380 3.as0 3:5a9c887b:::smithi17529564-26:head [append 0~81920] snapc d=[d,c,6] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.538440+0000", 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.501100453999999, 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094326859999999992, 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.078 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 380 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538440+0000", 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.079 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538440+0000", 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538441+0000", 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.066e-06 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538553+0000", 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011124399999999999 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538566+0000", 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.313e-05 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538575+0000", 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5270000000000004e-06 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.540453+0000", 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018772839999999999 2024-04-26T02:24:38.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.540683+0000", 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000230051 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.542174+0000", 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001491156 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.082 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.545570+0000", 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033959229999999999 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.547669+0000", 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020992020000000001 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.547873+0000", 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020410299999999999 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:381 3.as0 3:5a9c887b:::smithi17529564-26:head [setxattr _header (57) in=7b] snapc d=[d,c,6] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.538593+0000", 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.500947471, 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010144986, 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 381 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.084 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538593+0000", 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538593+0000", 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538594+0000", 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6300000000000004e-07 2024-04-26T02:24:38.085 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538600+0000", 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-06 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538610+0000", 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0117e-05 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538619+0000", 2024-04-26T02:24:38.086 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1960000000000008e-06 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.543234+0000", 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046159149999999999 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.543508+0000", 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027357 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.087 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.544830+0000", 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001322134 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548359+0000", 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035286929999999998 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548660+0000", 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030153299999999999 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.088 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548738+0000", 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7995000000000001e-05 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:382 3.as0 3:5a9c887b:::smithi17529564-26:head [read 0~1] snapc 0=[] RETRY=1 ondisk+retry+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.538630+0000", 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.500910869, 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013080127, 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.089 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 382 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538630+0000", 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.090 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538630+0000", 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538631+0000", 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2699999999999998e-07 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538634+0000", 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3100000000000001e-06 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.091 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538644+0000", 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0285999999999999e-05 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538663+0000", 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8819999999999999e-05 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548282+0000", 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0096185839999999995 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.092 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548353+0000", 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1117000000000004e-05 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.549218+0000", 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00086537599999999995 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.549455+0000", 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000236915 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.551710+0000", 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022548920000000001 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 59/31 ECSubWrite(tid=68, reqid=osd.15.0:68, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.558911+0000", 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.480629487, 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093286949999999997, 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.094 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558911+0000", 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558911+0000", 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.095 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558912+0000", 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4499999999999998e-07 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558947+0000", 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5403e-05 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558961+0000", 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3913e-05 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.096 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558974+0000", 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3286e-05 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559097+0000", 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012248000000000001 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559123+0000", 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6562000000000001e-05 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.097 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568180+0000", 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090561889999999992 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568240+0000", 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0516999999999997e-05 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.098 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.559011+0000", 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.480529409000001, 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012271604, 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559011+0000", 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.099 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559011+0000", 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559012+0000", 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559037+0000", 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5021999999999999e-05 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.100 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559050+0000", 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2676e-05 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559061+0000", 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0774999999999999e-05 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560084+0000", 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010236049999999999 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.101 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560098+0000", 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4187e-05 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.571213+0000", 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011114901999999999 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.571283+0000", 2024-04-26T02:24:38.102 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9865999999999998e-05 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.bs3 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.560316+0000", 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.479224438999999, 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084118820000000007, 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.103 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560316+0000", 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560316+0000", 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560317+0000", 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9799999999999999e-07 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.104 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560349+0000", 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2511000000000001e-05 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560369+0000", 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0069e-05 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560383+0000", 2024-04-26T02:24:38.105 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3645000000000001e-05 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560546+0000", 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016299000000000001 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560572+0000", 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5445000000000001e-05 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.106 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568687+0000", 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081157869999999993 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568728+0000", 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1037e-05 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.570018+0000", 2024-04-26T02:24:38.107 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.469523095, 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078694560000000004, 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570018+0000", 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.108 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570018+0000", 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570019+0000", 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4050000000000001e-06 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570058+0000", 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9065e-05 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.109 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570076+0000", 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8016000000000002e-05 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570089+0000", 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3096e-05 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570309+0000", 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021960799999999999 2024-04-26T02:24:38.110 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.570324+0000", 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4588e-05 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.577764+0000", 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074401689999999999 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.111 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.577887+0000", 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000123509 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 59/31 ECSubWrite(tid=170, reqid=osd.0.0:167, at_version=0'0, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.592292+0000", 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.447249233999999, 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061311830000000001, 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.112 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592292+0000", 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592292+0000", 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.113 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592293+0000", 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9299999999999996e-07 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592306+0000", 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3722e-05 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592318+0000", 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1443999999999999e-05 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.114 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592328+0000", 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0379e-05 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592434+0000", 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000105472 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.592444+0000", 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0328e-05 2024-04-26T02:24:38.115 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.598388+0000", 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059436289999999998 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.598423+0000", 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5315999999999999e-05 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.116 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 59/31 ECSubWrite(tid=171, reqid=osd.0.0:171, at_version=59'77, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.593245+0000", 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.446296265000001, 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077437189999999996, 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593245+0000", 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.117 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593245+0000", 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593245+0000", 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7999999999999995e-07 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593287+0000", 2024-04-26T02:24:38.118 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1488e-05 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593307+0000", 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0656e-05 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593316+0000", 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4710000000000007e-06 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.119 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593388+0000", 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1872000000000006e-05 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.593396+0000", 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5040000000000002e-06 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600906+0000", 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075092520000000001 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.120 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600988+0000", 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2795999999999998e-05 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 59/31 ECSubWrite(tid=172, reqid=osd.0.0:172, at_version=59'79, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.444540368, 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011057539, 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.121 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2099999999999996e-07 2024-04-26T02:24:38.122 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595027+0000", 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5669000000000001e-05 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595039+0000", 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2081e-05 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595047+0000", 2024-04-26T02:24:38.123 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0700000000000007e-06 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595114+0000", 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6616000000000001e-05 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595123+0000", 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1079999999999999e-06 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.606019+0000", 2024-04-26T02:24:38.124 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010895930999999999 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.606058+0000", 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9342999999999999e-05 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:507 3.ds0 3:bba78641:::smithi17529564-30:head [create,setxattr UrPUWbaU]cNfinVtoVUNsYX\\ahn\\oSdRW\\N[RcfO (807) in=40b,setxattr ZQoeVnpeaooblfNZklrg\\hmphZ^pTVh`eRXheade (1225) in=40b,setxattr kcjR][ah`rcmsWjUVlUeaofblgmpleUjjs^]ai\\t (7928) in=40b,setxattr `U^gRRs]UWRVngUaNeN^`p`aVl\\cn_a\\S`iTpOVo (1156) in=40b,setxattr aOYbW^`[gQfVcTQrq[NYeqh\\Q_bjiaWOefngkiNR (1331) in=40b,setxattr igNjm (735) in=5b,setxattr aQYs^c[hafOm^\\g[^R\\^QOd^eiS\\ghimncRcb_pi (15856) in=40b,setxattr dZUpqXmQYdS]obbkNRYdSsdUpenRkjiSSfUmqRTd (9612) in=40b,setxattr lX^flfV^[d^WmlW_UT^kV`s^ahfcNQsT`de`^spi (1612) in=40b,setxattr Ua`UXimY^dWVoQaji\\cZpP^er^hlbYQZs`USR`oh (10033) in=40b,setxattr XhOccedqUYhrPkk[^dVtangb_r^]alTl`ogaOPag (840) in=40b,setxattr YqbXbb\\oPeeR]rqcNaSsS`lkYoffXPcpaqhrb^te (418) in=40b,setxattr jdOeY]PQnfd[iZ^ph\\ijd[WRRnQ^phTpRROYeXss (1611) in=40b,setxattr ie\\ahhoaskiWrasYNh\\mUkqRso\\Olj\\c^P_\\bPp\\ (15577) in=40b,setxattr Ptb\\gnjjhTnd`OQag[dXTYa]t_id[PRpjt_ZfVY] (1541) in=40b,setxattr sSR]a[NPVaUQhPkla[ZVX`lTdim`fgjgeRtm`tt^ (841) in=40b,setxattr _cf[gnNmUkknhenPpY^\\lefOR_n\\mcb`iqOOPUiW (11296) in=40b,setxattr d[TVh[TTre^P`mnfob^WP[dckRkQZafjR[PaW^Zn (8912) in=40b,setxattr X[gWOjQtntoVfbZV[UObOVPoj`qib[[Zt]trgVjh (1542) in=40b,setxattr _qa\\VSbX\\\\b`tO_lSRnsf`PVNfmPkWrf[P\\ZTej[ (453) in=40b] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:27.467642+0000", 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.571898545, 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014433382, 2024-04-26T02:24:38.125 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 507 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467642+0000", 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.126 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467642+0000", 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467646+0000", 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5580000000000001e-06 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467838+0000", 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019233 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.127 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467873+0000", 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4328000000000001e-05 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467898+0000", 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5778999999999998e-05 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.128 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.468051+0000", 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015306 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.468062+0000", 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0564000000000001e-05 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.471010+0000", 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029476680000000001 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.129 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.471234+0000", 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000224121 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.473028+0000", 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001794138 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.477320+0000", 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042916209999999998 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.130 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481900+0000", 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045803679999999996 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.482076+0000", 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000175847 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.131 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:571 3.as0 3:5a56b440:::smithi17529564-4:head [append 0~0] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:37.577513+0000", 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.46202791900000001, 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0099776529999999995, 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 571 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.132 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577513+0000", 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577513+0000", 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577516+0000", 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7269999999999999e-06 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.133 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577527+0000", 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0909e-05 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577544+0000", 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7626e-05 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577556+0000", 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2064e-05 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.134 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.578559+0000", 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010026449999999999 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.578705+0000", 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014647999999999999 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.579913+0000", 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012078830000000001 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.135 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.586970+0000", 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070571410000000003 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.587402+0000", 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043182700000000002 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.587491+0000", 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8350999999999995e-05 2024-04-26T02:24:38.136 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:572 3.as0 3:5a56b440:::smithi17529564-4:head [rollback 12] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:37.577590+0000", 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.46195049900000001, 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015976830000000001, 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.137 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 572 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577590+0000", 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577590+0000", 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.138 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577591+0000", 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.23e-07 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577596+0000", 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9699999999999998e-06 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577612+0000", 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5994999999999998e-05 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.139 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577622+0000", 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5959999999999993e-06 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.580875+0000", 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032533729999999999 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.581154+0000", 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027908799999999998 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.140 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.582733+0000", 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001578533 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.587067+0000", 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043338120000000003 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593507+0000", 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064405010000000004 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.141 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593567+0000", 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0139000000000001e-05 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:573 3.as0 3:5a56b440:::smithi17529564-4:head [append 0~0] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.46190423000000003, 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01603773, 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:38.142 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 573 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:38.143 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6199999999999997e-07 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577641+0000", 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0840000000000002e-06 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577653+0000", 2024-04-26T02:24:38.144 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1299e-05 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577682+0000", 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8946999999999999e-05 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.583676+0000", 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059947940000000003 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.583947+0000", 2024-04-26T02:24:38.145 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000270778 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.585441+0000", 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014937150000000001 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593315+0000", 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078738509999999994 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:38.146 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593631+0000", 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000316607 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593674+0000", 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2993e-05 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:38.147 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:38.149 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:24:38.149 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:38.143+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:38.250 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:38.250+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:38.281 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:38.281 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:38.281 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:38.282 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:38.297 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:24:38.351 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:38.347+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:38.422 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:38.422 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:38.422 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:38.422 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:38.422 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:38.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:24:38.452 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:38.451+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:38.471 INFO:tasks.rados.rados.0.smithi175.stdout:226: done (4 left) 2024-04-26T02:24:38.471 INFO:tasks.rados.rados.0.smithi175.stdout:227: done (3 left) 2024-04-26T02:24:38.471 INFO:tasks.rados.rados.0.smithi175.stdout:230: done (2 left) 2024-04-26T02:24:38.471 INFO:tasks.rados.rados.0.smithi175.stdout:231: done (1 left) 2024-04-26T02:24:38.471 INFO:tasks.rados.rados.0.smithi175.stdout:232: done (0 left) 2024-04-26T02:24:38.471 INFO:tasks.rados.rados.0.smithi175.stdout:233: delete oid 29 current snap is 22 2024-04-26T02:24:38.475 INFO:tasks.rados.rados.0.smithi175.stdout:233: done (0 left) 2024-04-26T02:24:38.475 INFO:tasks.rados.rados.0.smithi175.stdout:234: delete oid 50 current snap is 22 2024-04-26T02:24:38.483 INFO:tasks.rados.rados.0.smithi175.stdout:234: done (0 left) 2024-04-26T02:24:38.483 INFO:tasks.rados.rados.0.smithi175.stdout:235: rollback oid 32 current snap is 22 2024-04-26T02:24:38.483 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 32 to 16 2024-04-26T02:24:38.484 INFO:tasks.rados.rados.0.smithi175.stdout:236: read oid 50 snap -1 2024-04-26T02:24:38.484 INFO:tasks.rados.rados.0.smithi175.stdout:236: expect deleted 2024-04-26T02:24:38.485 INFO:tasks.rados.rados.0.smithi175.stdout:237: rollback oid 22 current snap is 22 2024-04-26T02:24:38.485 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 22 to 17 2024-04-26T02:24:38.485 INFO:tasks.rados.rados.0.smithi175.stdout:238: delete oid 23 current snap is 22 2024-04-26T02:24:38.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:24:38.497 INFO:tasks.rados.rados.0.smithi175.stdout:236: done (3 left) 2024-04-26T02:24:38.497 INFO:tasks.rados.rados.0.smithi175.stdout:238: done (2 left) 2024-04-26T02:24:38.497 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 50 current snap is 22 2024-04-26T02:24:38.497 INFO:tasks.rados.rados.0.smithi175.stdout:239: seq_num 120 ranges {0=475136,475136=655360,1130496=622592,1753088=278528} 2024-04-26T02:24:38.504 INFO:tasks.rados.rados.0.smithi175.stdout:239: writing smithi17529564-50 from 0 to 475136 tid 1 2024-04-26T02:24:38.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:38.517 INFO:tasks.rados.rados.0.smithi175.stdout:239: writing smithi17529564-50 from 475136 to 1130496 tid 2 2024-04-26T02:24:38.528 INFO:tasks.rados.rados.0.smithi175.stdout:239: writing smithi17529564-50 from 1130496 to 1753088 tid 3 2024-04-26T02:24:38.534 INFO:tasks.rados.rados.0.smithi175.stdout:239: writing smithi17529564-50 from 1753088 to 2031616 tid 4 2024-04-26T02:24:38.534 INFO:tasks.rados.rados.0.smithi175.stdout:240: copy_from oid 4 from oid 27 current snap is 22 2024-04-26T02:24:38.534 INFO:tasks.rados.rados.0.smithi175.stdout:237: finishing rollback tid 0 to smithi17529564-22 2024-04-26T02:24:38.534 INFO:tasks.rados.rados.0.smithi175.stdout:237: finishing rollback tid 1 to smithi17529564-22 2024-04-26T02:24:38.534 INFO:tasks.rados.rados.0.smithi175.stdout:237: finishing rollback tid 2 to smithi17529564-22 2024-04-26T02:24:38.534 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 22 v 30 (ObjNum 97 snap 13 seq_num 97) dirty exists 2024-04-26T02:24:38.535 INFO:tasks.rados.rados.0.smithi175.stdout:235: finishing rollback tid 0 to smithi17529564-32 2024-04-26T02:24:38.535 INFO:tasks.rados.rados.0.smithi175.stdout:235: finishing rollback tid 1 to smithi17529564-32 2024-04-26T02:24:38.535 INFO:tasks.rados.rados.0.smithi175.stdout:237: done (3 left) 2024-04-26T02:24:38.535 INFO:tasks.rados.rados.0.smithi175.stdout:241: snap_remove snap 19 2024-04-26T02:24:38.588 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:38.587+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:38.631 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:38.631 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:38.631 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:38.631 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:38.631 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.631 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:38.631 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.564844+0000", 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.062731632, 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011141359999999999, 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564844+0000", 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.632 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564844+0000", 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564845+0000", 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8299999999999996e-07 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.633 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564899+0000", 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4178999999999997e-05 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564931+0000", 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1656999999999999e-05 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.564953+0000", 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2186000000000001e-05 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.634 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.565125+0000", 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017197499999999999 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.565151+0000", 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6190000000000002e-05 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575915+0000", 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010764174 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.635 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.636 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575985+0000", 2024-04-26T02:24:38.636 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0315999999999996e-05 2024-04-26T02:24:38.636 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.636 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.061547062000001, 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012199435999999999, 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.637 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.638 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:24:38.638 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.638 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.638 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.638 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566086+0000", 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6326000000000002e-05 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.639 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566114+0000", 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8186000000000001e-05 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566138+0000", 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4130000000000001e-05 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.640 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566303+0000", 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016472500000000001 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566327+0000", 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4386999999999999e-05 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578144+0000", 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011816432999999999 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.641 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578228+0000", 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4561999999999994e-05 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.567191+0000", 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.060385096999999, 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013432176000000001, 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.642 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567191+0000", 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567191+0000", 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567192+0000", 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.813e-06 2024-04-26T02:24:38.643 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567260+0000", 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7366000000000005e-05 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567291+0000", 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1625999999999998e-05 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567312+0000", 2024-04-26T02:24:38.644 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0942999999999999e-05 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567842+0000", 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000530015 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567942+0000", 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9499000000000004e-05 2024-04-26T02:24:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.646 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.646 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.646 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580519+0000", 2024-04-26T02:24:38.647 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012576942000000001 2024-04-26T02:24:38.647 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.647 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.647 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580623+0000", 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103972 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.570894+0000", 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.056681663999999, 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012106647, 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.648 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.649 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.649 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.649 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.649 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570894+0000", 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570894+0000", 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570896+0000", 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8300000000000001e-06 2024-04-26T02:24:38.650 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570951+0000", 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5038999999999999e-05 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570983+0000", 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2344000000000001e-05 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571006+0000", 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3045999999999999e-05 2024-04-26T02:24:38.651 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573955+0000", 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002948942 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573983+0000", 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7373e-05 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.582913+0000", 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0089305370000000005 2024-04-26T02:24:38.652 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.583001+0000", 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7535999999999997e-05 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.573939+0000", 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.053637027000001, 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0094553659999999998, 2024-04-26T02:24:38.653 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573939+0000", 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573939+0000", 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.654 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573941+0000", 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.857e-06 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573991+0000", 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0526999999999999e-05 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.574019+0000", 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7781999999999999e-05 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.655 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.574044+0000", 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5052999999999999e-05 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.574329+0000", 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028488100000000001 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.574353+0000", 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4320000000000001e-05 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.656 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.657 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.657 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.583317+0000", 2024-04-26T02:24:38.657 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0089639569999999998 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.583394+0000", 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6989000000000004e-05 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=136, reqid=osd.12.0:135, at_version=0'0, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.588509+0000", 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.039066339, 2024-04-26T02:24:38.658 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092308379999999999, 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588509+0000", 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588509+0000", 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.659 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588510+0000", 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4300000000000001e-07 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588532+0000", 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1427e-05 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588557+0000", 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4816000000000001e-05 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.660 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588577+0000", 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0044e-05 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588817+0000", 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000239993 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.588841+0000", 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.482e-05 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.661 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.597595+0000", 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087539699999999998 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.597740+0000", 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014482500000000001 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:513 3.0s0 3:0bf26ae6:::smithi17529564-36:head [append 0~622592] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.498269+0000", 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.129306465999999, 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011959111, 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 513 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.498269+0000", 2024-04-26T02:24:38.663 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.498269+0000", 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.498272+0000", 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7700000000000002e-06 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499538+0000", 2024-04-26T02:24:38.664 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001266386 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499572+0000", 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3469000000000001e-05 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499587+0000", 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5586999999999998e-05 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499752+0000", 2024-04-26T02:24:38.665 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016427100000000001 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.500059+0000", 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000307177 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.503353+0000", 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0032943920000000002 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.509502+0000", 2024-04-26T02:24:38.666 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061491569999999997 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510035+0000", 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00053225099999999997 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510228+0000", 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019365100000000001 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.667 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:514 3.0s0 3:0bf26ae6:::smithi17529564-36:head [append 0~442368] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.504106+0000", 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.123469539, 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010689969000000001, 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 514 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.668 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.504106+0000", 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.504106+0000", 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.504109+0000", 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7829999999999999e-06 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.669 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.505235+0000", 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011259079999999999 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.505359+0000", 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00012462899999999999 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.505384+0000", 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4865999999999999e-05 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.670 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.505966+0000", 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00058153100000000004 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.506296+0000", 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00033035600000000002 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.507839+0000", 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015424869999999999 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.671 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510252+0000", 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024128740000000002 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.514571+0000", 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043197610000000001 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.514796+0000", 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022477400000000001 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.672 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:515 3.0s0 3:0bf26ae6:::smithi17529564-36:head [append 0~524288] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.509339+0000", 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.118236645, 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011117098000000001, 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 515 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.509339+0000", 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.509339+0000", 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.509342+0000", 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.96e-06 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510397+0000", 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010550589999999999 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510428+0000", 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1291999999999998e-05 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510450+0000", 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1967000000000002e-05 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510549+0000", 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8858999999999997e-05 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510702+0000", 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000152495 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.512307+0000", 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001604966 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.519848+0000", 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075411690000000003 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.520289+0000", 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000440946 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.520456+0000", 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016738500000000001 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:516 3.0s0 3:0bf26ae6:::smithi17529564-36:head [append 0~196608] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.511518+0000", 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.116057635000001, 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010441295, 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 516 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511518+0000", 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511518+0000", 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511521+0000", 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.757e-06 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511739+0000", 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021787999999999999 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511772+0000", 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3404000000000001e-05 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511794+0000", 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2226e-05 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.515395+0000", 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0036006409999999999 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.515563+0000", 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016831499999999999 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.516880+0000", 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001316619 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.520710+0000", 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038302359999999999 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.521794+0000", 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001083879 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.521959+0000", 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016533800000000001 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.682 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:517 3.0s0 3:0bf26ae6:::smithi17529564-36:head [setxattr _header (57) in=7b] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.511858+0000", 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.115717889000001, 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010724365, 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 517 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511858+0000", 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511858+0000", 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511859+0000", 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1340000000000001e-06 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511865+0000", 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2600000000000002e-06 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511880+0000", 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4443e-05 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511893+0000", 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3423e-05 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.518036+0000", 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061426609999999998 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.518190+0000", 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015412800000000001 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.519275+0000", 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001085162 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.520948+0000", 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0016726689999999999 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.522416+0000", 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014678709999999999 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.522582+0000", 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016661399999999999 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.687 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:518 3.0s0 3:0bf26ae6:::smithi17529564-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.511911+0000", 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.115664856, 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014919874, 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 518 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.688 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511911+0000", 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511911+0000", 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511912+0000", 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0699999999999996e-07 2024-04-26T02:24:38.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511917+0000", 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3090000000000003e-06 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511947+0000", 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9697e-05 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511960+0000", 2024-04-26T02:24:38.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3186999999999999e-05 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.521178+0000", 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092181810000000006 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.521326+0000", 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000147775 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.523387+0000", 2024-04-26T02:24:38.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020608779999999999 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.523572+0000", 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018491100000000001 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.526831+0000", 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0032590290000000001 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 66/31 ECSubWrite(tid=201, reqid=osd.0.0:201, at_version=66'104, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.473967+0000", 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.1536088109999998, 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016992693, 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.473967+0000", 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.473967+0000", 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.473968+0000", 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6599999999999996e-07 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474032+0000", 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4284999999999999e-05 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474058+0000", 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6041999999999999e-05 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474079+0000", 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0795999999999999e-05 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474264+0000", 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018564499999999999 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474290+0000", 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5269000000000002e-05 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490867+0000", 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016577034000000001 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490960+0000", 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2955999999999996e-05 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.474158+0000", 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.153417889, 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011861017999999999, 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474158+0000", 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474158+0000", 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474159+0000", 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.046e-06 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474201+0000", 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.2101999999999998e-05 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474225+0000", 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4009e-05 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474244+0000", 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.874e-05 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474439+0000", 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019479100000000001 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474464+0000", 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5119000000000001e-05 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485946+0000", 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011481954000000001 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486019+0000", 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3256999999999993e-05 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.700 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.bs4 66/31 ECSubWrite(tid=39, reqid=osd.7.0:39, at_version=66'29, trim_to=0'0, roll_forward_to=65'27))", 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475121+0000", 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.152455089, 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011019853, 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475121+0000", 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475121+0000", 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475121+0000", 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1299999999999999e-07 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475169+0000", 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7981e-05 2024-04-26T02:24:38.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475193+0000", 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4023e-05 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475214+0000", 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0865000000000001e-05 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475384+0000", 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016949700000000001 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475409+0000", 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5272000000000001e-05 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486049+0000", 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010640105 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486140+0000", 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1297000000000004e-05 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.704 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475709+0000", 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.1518667369999998, 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015346538, 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475709+0000", 2024-04-26T02:24:38.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475709+0000", 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475716+0000", 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6229999999999999e-06 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475766+0000", 2024-04-26T02:24:38.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9938000000000002e-05 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475904+0000", 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000138474 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475926+0000", 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2011999999999999e-05 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478279+0000", 2024-04-26T02:24:38.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002352682 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478303+0000", 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4156e-05 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490997+0000", 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012694643 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491056+0000", 2024-04-26T02:24:38.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8010000000000002e-05 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475802+0000", 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.1517732809999996, 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015258839, 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475802+0000", 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475802+0000", 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475803+0000", 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7000000000000004e-07 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475846+0000", 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3291999999999998e-05 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3598999999999999e-05 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475887+0000", 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7201999999999999e-05 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476231+0000", 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034379899999999999 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476253+0000", 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2126000000000001e-05 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490991+0000", 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014737584 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491061+0000", 2024-04-26T02:24:38.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0567000000000004e-05 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.480090+0000", 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.1474854900000002, 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012901797, 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480090+0000", 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480090+0000", 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480092+0000", 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6959999999999999e-06 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480146+0000", 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4131000000000001e-05 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480179+0000", 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2842999999999997e-05 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480201+0000", 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2204999999999998e-05 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484567+0000", 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004366244 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484596+0000", 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8169000000000001e-05 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492902+0000", 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083067230000000002 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492992+0000", 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9785999999999997e-05 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.480426+0000", 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.1471496910000001, 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012543535999999999, 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.717 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480426+0000", 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480426+0000", 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480428+0000", 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.903e-06 2024-04-26T02:24:38.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480589+0000", 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016117700000000001 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480619+0000", 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0218000000000001e-05 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480642+0000", 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2943e-05 2024-04-26T02:24:38.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486346+0000", 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057037650000000004 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486370+0000", 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3626e-05 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492860+0000", 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0064904589999999996 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492970+0000", 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010944500000000001 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.6s6 66/31 ECSubWrite(tid=78, reqid=osd.15.0:77, at_version=0'0, trim_to=0'0, roll_forward_to=66'60))", 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.484274+0000", 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.143301428, 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0087945790000000003, 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:38.721 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484274+0000", 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484274+0000", 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484276+0000", 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9999999999999999e-06 2024-04-26T02:24:38.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484305+0000", 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9108e-05 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484341+0000", 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5358999999999998e-05 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484363+0000", 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2688999999999999e-05 2024-04-26T02:24:38.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485155+0000", 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00079186700000000003 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485180+0000", 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4258999999999999e-05 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492929+0000", 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077492059999999998 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:38.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493069+0000", 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014009100000000001 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:38.725 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:38.726 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:38.727 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:38.727 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:38.728 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:24:38.728 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:38.723+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:38.741 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:38.742 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:38.763 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:38.763 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:38.780 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:38.780 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:38.798 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:38.799 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:38.819 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:38.819 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:38.830 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:38.823+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:38.840 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:38.841 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:38.854 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:38.855 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:38.859 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:38.859 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:38.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:24:38.880 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:38.880 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:38.899 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:38.900 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:38.919 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:38.920 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:38.928 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:38.923+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:38.935 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:38.936 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:38.954 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:38.955 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:38.975 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:38.975 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:38.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:38.975+0000 7f3cb296c640 0 -- 172.21.15.59:0/2968695113 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f3cac223880 msgr2=0x7f3cac225c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:38.994 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:38.994 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:39.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:24:39.051 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:39.047+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:39.130 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:39.123+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:39.169 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:39.169 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:39.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:24:39.203 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:39.203 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:39.232 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:39.231+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:39.333 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:39.330+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:39.348 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:39.348 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:39.362 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:24:39.433 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:39.427+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:39.473 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:24:39.478 INFO:tasks.rados.rados.0.smithi175.stdout:241: done (3 left) 2024-04-26T02:24:39.478 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 20 current snap is 22 2024-04-26T02:24:39.479 INFO:tasks.rados.rados.0.smithi175.stdout:242: seq_num 121 ranges {0=491520,491520=802816,1294336=720896,2015232=32768} 2024-04-26T02:24:39.488 INFO:tasks.rados.rados.0.smithi175.stdout:242: writing smithi17529564-20 from 0 to 491520 tid 1 2024-04-26T02:24:39.489 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:39.489 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:39.502 INFO:tasks.rados.rados.0.smithi175.stdout:242: writing smithi17529564-20 from 491520 to 1294336 tid 2 2024-04-26T02:24:39.509 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:24:39.516 INFO:tasks.rados.rados.0.smithi175.stdout:242: writing smithi17529564-20 from 1294336 to 2015232 tid 3 2024-04-26T02:24:39.517 INFO:tasks.rados.rados.0.smithi175.stdout:242: writing smithi17529564-20 from 2015232 to 2048000 tid 4 2024-04-26T02:24:39.518 INFO:tasks.rados.rados.0.smithi175.stdout:243: snap_remove snap 21 2024-04-26T02:24:39.534 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:39.530+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:39.635 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:39.631+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:39.670 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:39.670 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:39.685 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:24:39.736 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:39.731+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:39.803 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:39.803 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:39.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:24:39.837 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:39.831+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:39.938 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:39.938 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:39.939 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:39.933+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:39.952 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:40.040 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:40.039+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:40.069 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:40.069 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:40.082 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:40.141 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:40.139+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:40.215 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:40.215 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:40.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:40.241 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:40.239+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:40.343 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:40.339+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:40.349 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:40.349 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:40.364 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:40.444 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:40.443+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:243: done (4 left) 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:244: read oid 46 snap -1 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:244: expect (ObjNum 108 snap 16 seq_num 108) 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 30 current snap is 22 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:235: finishing rollback tid 2 to smithi17529564-32 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 32 v 64 (ObjNum 103 snap 13 seq_num 103) dirty exists 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:239: finishing write tid 1 to smithi17529564-50 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:239: finishing write tid 2 to smithi17529564-50 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:239: finishing write tid 3 to smithi17529564-50 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:239: finishing write tid 4 to smithi17529564-50 2024-04-26T02:24:40.487 INFO:tasks.rados.rados.0.smithi175.stdout:239: finishing write tid 5 to smithi17529564-50 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:240: finishing copy_from racing read to smithi17529564-4 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:239: finishing write tid 6 to smithi17529564-50 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:239: oid 50 updating version 0 to 121 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:239: oid 50 version 121 is already newer than 118 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:239: oid 50 updating version 121 to 122 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:239: oid 50 version 122 is already newer than 119 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:239: oid 50 version 122 is already newer than 120 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 50 v 122 (ObjNum 120 snap 22 seq_num 120) dirty exists 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:239: left oid 50 (ObjNum 120 snap 22 seq_num 120) 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:240: finishing copy_from to smithi17529564-4 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 26 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:242: finishing write tid 1 to smithi17529564-20 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:242: finishing write tid 2 to smithi17529564-20 2024-04-26T02:24:40.488 INFO:tasks.rados.rados.0.smithi175.stdout:242: finishing write tid 3 to smithi17529564-20 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: finishing write tid 4 to smithi17529564-20 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: finishing write tid 5 to smithi17529564-20 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: finishing write tid 6 to smithi17529564-20 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: oid 20 updating version 0 to 35 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: oid 20 updating version 35 to 38 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: oid 20 version 38 is already newer than 36 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: oid 20 version 38 is already newer than 37 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: oid 20 version 38 is already newer than 34 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 20 v 38 (ObjNum 121 snap 22 seq_num 121) dirty exists 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:242: left oid 20 (ObjNum 121 snap 22 seq_num 121) 2024-04-26T02:24:40.489 INFO:tasks.rados.rados.0.smithi175.stdout:245: seq_num 122 ranges {4243456=507904,4751360=425984,5177344=442368,5619712=540672,6160384=147456} 2024-04-26T02:24:40.542 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:40.542 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:40.545 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:40.541+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:40.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:40.560 INFO:tasks.rados.rados.0.smithi175.stdout:245: writing smithi17529564-30 from 4243456 to 4751360 tid 1 2024-04-26T02:24:40.564 INFO:tasks.rados.rados.0.smithi175.stdout:245: writing smithi17529564-30 from 4751360 to 5177344 tid 2 2024-04-26T02:24:40.568 INFO:tasks.rados.rados.0.smithi175.stdout:245: writing smithi17529564-30 from 5177344 to 5619712 tid 3 2024-04-26T02:24:40.569 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:40.569 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:40.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:40.573 INFO:tasks.rados.rados.0.smithi175.stdout:245: writing smithi17529564-30 from 5619712 to 6160384 tid 4 2024-04-26T02:24:40.574 INFO:tasks.rados.rados.0.smithi175.stdout:245: writing smithi17529564-30 from 6160384 to 6307840 tid 5 2024-04-26T02:24:40.574 INFO:tasks.rados.rados.0.smithi175.stdout:235: done (5 left) 2024-04-26T02:24:40.574 INFO:tasks.rados.rados.0.smithi175.stdout:239: done (4 left) 2024-04-26T02:24:40.574 INFO:tasks.rados.rados.0.smithi175.stdout:240: done (3 left) 2024-04-26T02:24:40.574 INFO:tasks.rados.rados.0.smithi175.stdout:242: done (2 left) 2024-04-26T02:24:40.574 INFO:tasks.rados.rados.0.smithi175.stdout:246: rmattr oid 8 current snap is 22 2024-04-26T02:24:40.574 INFO:tasks.rados.rados.0.smithi175.stdout:246: done (2 left) 2024-04-26T02:24:40.575 INFO:tasks.rados.rados.0.smithi175.stdout:247: snap_remove snap 18 2024-04-26T02:24:40.646 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:40.643+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:40.679 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:40.680 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:40.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:40.782 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:40.779+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:40.849 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:40.843+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:40.860 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:40.860 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:40.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:40.877 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:40.883 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:40.896 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-04-26T02:24:40.722627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":82493984,"num_objects":61,"num_object_clones":13,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":4,"num_read":391,"num_read_kb":61255,"num_write":716,"num_write_kb":94372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":835,"ondisk_log_size":835,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":616448,"kb_used_data":154944,"kb_used_omap":24,"kb_used_meta":461223,"kb_avail":1509332992,"statfs":{"total":1546188226560,"available":1545556983808,"internally_reserved":0,"allocated":158662656,"data_stored":174301125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":472292435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":212992,"num_objects":-7,"num_object_clones":-6,"num_object_copies":-49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7,"num_whiteouts":-2,"num_read":6,"num_read_kb":4898,"num_write":10,"num_write_kb":1984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000824"},"pg_stats":[{"pgid":"3.f","version":"66'52","reported_seq":250,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.479882+0000","last_change":"2024-04-26T02:24:37.466479+0000","last_active":"2024-04-26T02:24:38.479882+0000","last_peered":"2024-04-26T02:24:38.479882+0000","last_clean":"2024-04-26T02:24:38.479882+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:38.479882+0000","last_undegraded":"2024-04-26T02:24:38.479882+0000","last_fullsized":"2024-04-26T02:24:38.479882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:21.066603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010558950000000001,"stat_sum":{"num_bytes":6144000,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":4137,"num_write":24,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.e","version":"66'26","reported_seq":208,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.480167+0000","last_change":"2024-04-26T02:24:33.496003+0000","last_active":"2024-04-26T02:24:35.480167+0000","last_peered":"2024-04-26T02:24:35.480167+0000","last_clean":"2024-04-26T02:24:35.480167+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:35.480167+0000","last_undegraded":"2024-04-26T02:24:35.480167+0000","last_fullsized":"2024-04-26T02:24:35.480167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:59.949158+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.021790156000000001,"stat_sum":{"num_bytes":1818624,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1005,"num_write":32,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.d","version":"71'64","reported_seq":263,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.503400+0000","last_change":"2024-04-26T02:24:37.578441+0000","last_active":"2024-04-26T02:24:38.503400+0000","last_peered":"2024-04-26T02:24:38.503400+0000","last_clean":"2024-04-26T02:24:38.503400+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:38.503400+0000","last_undegraded":"2024-04-26T02:24:38.503400+0000","last_fullsized":"2024-04-26T02:24:38.503400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.371065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001242319,"stat_sum":{"num_bytes":13320192,"num_objects":6,"num_object_clones":1,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":4622,"num_write":59,"num_write_kb":14752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.c","version":"71'122","reported_seq":322,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.540644+0000","last_change":"2024-04-26T02:24:37.465691+0000","last_active":"2024-04-26T02:24:38.540644+0000","last_peered":"2024-04-26T02:24:38.540644+0000","last_clean":"2024-04-26T02:24:38.540644+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:38.540644+0000","last_undegraded":"2024-04-26T02:24:38.540644+0000","last_fullsized":"2024-04-26T02:24:38.540644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:11.075671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010567109999999999,"stat_sum":{"num_bytes":16891904,"num_objects":12,"num_object_clones":4,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":1,"num_read":45,"num_read_kb":20469,"num_write":59,"num_write_kb":16496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.b","version":"66'29","reported_seq":213,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T02:24:36.474975+0000","last_change":"2024-04-26T02:24:33.491083+0000","last_active":"2024-04-26T02:24:36.474975+0000","last_peered":"2024-04-26T02:24:36.474975+0000","last_clean":"2024-04-26T02:24:36.474975+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:36.474975+0000","last_undegraded":"2024-04-26T02:24:36.474975+0000","last_fullsized":"2024-04-26T02:24:36.474975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.679463+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.018670782,"stat_sum":{"num_bytes":3309568,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":37,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.a","version":"71'59","reported_seq":245,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.540975+0000","last_change":"2024-04-26T02:24:37.586763+0000","last_active":"2024-04-26T02:24:38.540975+0000","last_peered":"2024-04-26T02:24:38.540975+0000","last_clean":"2024-04-26T02:24:38.540975+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:38.540975+0000","last_undegraded":"2024-04-26T02:24:38.540975+0000","last_fullsized":"2024-04-26T02:24:38.540975+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.007536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010164596999999999,"stat_sum":{"num_bytes":4292608,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":45,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"16","length":"1"}]},{"pgid":"3.9","version":"66'44","reported_seq":223,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.479782+0000","last_change":"2024-04-26T02:24:33.517447+0000","last_active":"2024-04-26T02:24:35.479782+0000","last_peered":"2024-04-26T02:24:35.479782+0000","last_clean":"2024-04-26T02:24:35.479782+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:35.479782+0000","last_undegraded":"2024-04-26T02:24:35.479782+0000","last_fullsized":"2024-04-26T02:24:35.479782+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.713547+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.043667020000000001,"stat_sum":{"num_bytes":2949120,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":2,"num_read":15,"num_read_kb":247,"num_write":38,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.8","version":"66'46","reported_seq":227,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.480151+0000","last_change":"2024-04-26T02:24:33.494226+0000","last_active":"2024-04-26T02:24:35.480151+0000","last_peered":"2024-04-26T02:24:35.480151+0000","last_clean":"2024-04-26T02:24:35.480151+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:35.480151+0000","last_undegraded":"2024-04-26T02:24:35.480151+0000","last_fullsized":"2024-04-26T02:24:35.480151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:18.431419+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.021612363999999998,"stat_sum":{"num_bytes":4259840,"num_objects":5,"num_object_clones":1,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":3129,"num_write":40,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"1.0","version":"26'157","reported_seq":291,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.480401+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:35.480401+0000","last_peered":"2024-04-26T02:24:35.480401+0000","last_clean":"2024-04-26T02:24:35.480401+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:35.480401+0000","last_undegraded":"2024-04-26T02:24:35.480401+0000","last_fullsized":"2024-04-26T02:24:35.480401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T02:24:36.477431+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:36.477431+0000","last_peered":"2024-04-26T02:24:36.477431+0000","last_clean":"2024-04-26T02:24:36.477431+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:36.477431+0000","last_undegraded":"2024-04-26T02:24:36.477431+0000","last_fullsized":"2024-04-26T02:24:36.477431+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"66'22","reported_seq":201,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T02:24:36.477505+0000","last_change":"2024-04-26T02:24:33.503155+0000","last_active":"2024-04-26T02:24:36.477505+0000","last_peered":"2024-04-26T02:24:36.477505+0000","last_clean":"2024-04-26T02:24:36.477505+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:36.477505+0000","last_undegraded":"2024-04-26T02:24:36.477505+0000","last_fullsized":"2024-04-26T02:24:36.477505+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.608918+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.023144057999999999,"stat_sum":{"num_bytes":1998848,"num_objects":2,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":10,"num_write_kb":2272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.476462+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:38.476462+0000","last_peered":"2024-04-26T02:24:38.476462+0000","last_clean":"2024-04-26T02:24:38.476462+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:38.476462+0000","last_undegraded":"2024-04-26T02:24:38.476462+0000","last_fullsized":"2024-04-26T02:24:38.476462+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"66'40","reported_seq":222,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.478111+0000","last_change":"2024-04-26T02:24:33.511398+0000","last_active":"2024-04-26T02:24:35.478111+0000","last_peered":"2024-04-26T02:24:35.478111+0000","last_clean":"2024-04-26T02:24:35.478111+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:35.478111+0000","last_undegraded":"2024-04-26T02:24:35.478111+0000","last_fullsized":"2024-04-26T02:24:35.478111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:10.680351+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.021886158999999999,"stat_sum":{"num_bytes":9093120,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":13208,"num_write":21,"num_write_kb":9568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T02:24:36.477268+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:36.477268+0000","last_peered":"2024-04-26T02:24:36.477268+0000","last_clean":"2024-04-26T02:24:36.477268+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:36.477268+0000","last_undegraded":"2024-04-26T02:24:36.477268+0000","last_fullsized":"2024-04-26T02:24:36.477268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"66'35","reported_seq":216,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.478753+0000","last_change":"2024-04-26T02:24:33.486886+0000","last_active":"2024-04-26T02:24:35.478753+0000","last_peered":"2024-04-26T02:24:35.478753+0000","last_clean":"2024-04-26T02:24:35.478753+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:35.478753+0000","last_undegraded":"2024-04-26T02:24:35.478753+0000","last_fullsized":"2024-04-26T02:24:35.478753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:04.171528+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.018778862,"stat_sum":{"num_bytes":6848512,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2360,"num_write":22,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.477571+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:38.477571+0000","last_peered":"2024-04-26T02:24:38.477571+0000","last_clean":"2024-04-26T02:24:38.477571+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:38.477571+0000","last_undegraded":"2024-04-26T02:24:38.477571+0000","last_fullsized":"2024-04-26T02:24:38.477571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":174,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.474642+0000","last_change":"2024-04-26T02:24:33.472842+0000","last_active":"2024-04-26T02:24:35.474642+0000","last_peered":"2024-04-26T02:24:35.474642+0000","last_clean":"2024-04-26T02:24:35.474642+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:35.474642+0000","last_undegraded":"2024-04-26T02:24:35.474642+0000","last_fullsized":"2024-04-26T02:24:35.474642+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:58.980876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079675700000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"3.5","version":"66'53","reported_seq":254,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.477088+0000","last_change":"2024-04-26T02:24:37.589441+0000","last_active":"2024-04-26T02:24:38.477088+0000","last_peered":"2024-04-26T02:24:38.477088+0000","last_clean":"2024-04-26T02:24:38.477088+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:38.477088+0000","last_undegraded":"2024-04-26T02:24:38.477088+0000","last_fullsized":"2024-04-26T02:24:38.477088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.750111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083927700000000004,"stat_sum":{"num_bytes":3473408,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":4831,"num_write":66,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"16","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":90,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.478106+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:35.478106+0000","last_peered":"2024-04-26T02:24:35.478106+0000","last_clean":"2024-04-26T02:24:35.478106+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:35.478106+0000","last_undegraded":"2024-04-26T02:24:35.478106+0000","last_fullsized":"2024-04-26T02:24:35.478106+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":179,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T02:24:36.475074+0000","last_change":"2024-04-26T02:24:33.474649+0000","last_active":"2024-04-26T02:24:36.475074+0000","last_peered":"2024-04-26T02:24:36.475074+0000","last_clean":"2024-04-26T02:24:36.475074+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:36.475074+0000","last_undegraded":"2024-04-26T02:24:36.475074+0000","last_fullsized":"2024-04-26T02:24:36.475074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:06.561074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00194009,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":92,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-26T02:24:36.498280+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:36.498280+0000","last_peered":"2024-04-26T02:24:36.498280+0000","last_clean":"2024-04-26T02:24:36.498280+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:36.498280+0000","last_undegraded":"2024-04-26T02:24:36.498280+0000","last_fullsized":"2024-04-26T02:24:36.498280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"67'26","reported_seq":220,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-26T02:24:39.485526+0000","last_change":"2024-04-26T02:24:39.486386+0000","last_active":"2024-04-26T02:24:39.485526+0000","last_peered":"2024-04-26T02:24:39.485526+0000","last_clean":"2024-04-26T02:24:39.485526+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:39.485526+0000","last_undegraded":"2024-04-26T02:24:39.485526+0000","last_fullsized":"2024-04-26T02:24:39.485526+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.228336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014914189999999999,"stat_sum":{"num_bytes":770048,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":5,"num_read_kb":2,"num_write":9,"num_write_kb":752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"d","length":"1"},{"start":"f","length":"1"},{"start":"15","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":90,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.480041+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:35.480041+0000","last_peered":"2024-04-26T02:24:35.480041+0000","last_clean":"2024-04-26T02:24:35.480041+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:35.480041+0000","last_undegraded":"2024-04-26T02:24:35.480041+0000","last_fullsized":"2024-04-26T02:24:35.480041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"66'60","reported_seq":240,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-26T02:24:35.480139+0000","last_change":"2024-04-26T02:24:33.486251+0000","last_active":"2024-04-26T02:24:35.480139+0000","last_peered":"2024-04-26T02:24:35.480139+0000","last_clean":"2024-04-26T02:24:35.480139+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:35.480139+0000","last_undegraded":"2024-04-26T02:24:35.480139+0000","last_fullsized":"2024-04-26T02:24:35.480139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:23.991048+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.017819501000000001,"stat_sum":{"num_bytes":6733824,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":7113,"num_write":51,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"6","length":"1"},{"start":"d","length":"1"},{"start":"f","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":96,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-26T02:24:38.477126+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:38.477126+0000","last_peered":"2024-04-26T02:24:38.477126+0000","last_clean":"2024-04-26T02:24:38.477126+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:38.477126+0000","last_undegraded":"2024-04-26T02:24:38.477126+0000","last_fullsized":"2024-04-26T02:24:38.477126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":81903616,"num_objects":59,"num_object_clones":13,"num_object_copies":413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":4,"num_read":255,"num_read_kb":61137,"num_write":513,"num_write_kb":90912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142753792,"data_stored":167632896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":678,"ondisk_log_size":678,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215120,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42516,"kb_used_data":11336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329324,"statfs":{"total":96636764160,"available":96593227776,"internally_reserved":0,"allocated":11608064,"data_stored":13500329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215117,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37772,"kb_used_data":6592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334068,"statfs":{"total":96636764160,"available":96598085632,"internally_reserved":0,"allocated":6750208,"data_stored":6680489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215117,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43756,"kb_used_data":12572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328084,"statfs":{"total":96636764160,"available":96591958016,"internally_reserved":0,"allocated":12873728,"data_stored":15546314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313229,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40624,"kb_used_data":13592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331216,"statfs":{"total":96636764160,"available":96595165184,"internally_reserved":0,"allocated":13918208,"data_stored":16924707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38604,"kb_used_data":7420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333236,"statfs":{"total":96636764160,"available":96597233664,"internally_reserved":0,"allocated":7598080,"data_stored":7386838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280525,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":4292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":4395008,"data_stored":3983062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280526,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41508,"kb_used_data":14484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330332,"statfs":{"total":96636764160,"available":96594259968,"internally_reserved":0,"allocated":14831616,"data_stored":16535287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36912,"kb_used_data":9888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334928,"statfs":{"total":96636764160,"available":96598966272,"internally_reserved":0,"allocated":10125312,"data_stored":10350327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280526,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34332,"kb_used_data":7308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337508,"statfs":{"total":96636764160,"available":96601608192,"internally_reserved":0,"allocated":7483392,"data_stored":7667447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280524,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38032,"kb_used_data":11008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94333808,"statfs":{"total":96636764160,"available":96597819392,"internally_reserved":0,"allocated":11272192,"data_stored":12975863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280524,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36504,"kb_used_data":5320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335336,"statfs":{"total":96636764160,"available":96599384064,"internally_reserved":0,"allocated":5447680,"data_stored":5185815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280525,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34504,"kb_used_data":7480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337336,"statfs":{"total":96636764160,"available":96601432064,"internally_reserved":0,"allocated":7659520,"data_stored":7999767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41892,"kb_used_data":10704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329948,"statfs":{"total":96636764160,"available":96593866752,"internally_reserved":0,"allocated":10960896,"data_stored":12056344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280525,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39884,"kb_used_data":12860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331956,"statfs":{"total":96636764160,"available":96595922944,"internally_reserved":0,"allocated":13168640,"data_stored":14069495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280525,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":6160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":6307840,"data_stored":5889783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215117,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45112,"kb_used_data":13928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326728,"statfs":{"total":96636764160,"available":96590569472,"internally_reserved":0,"allocated":14262272,"data_stored":17549258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13266944,"data_stored":16990208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":13885440,"data_stored":16007168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6537216,"data_stored":7139328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":16355328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":14987264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3969024,"data_stored":4128768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6180864,"data_stored":6942720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9998336,"data_stored":11517952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":5771264,"data_stored":7614464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12222464,"data_stored":13541376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":6668288,"data_stored":6868992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":3465216,"data_stored":3465216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":11137024,"data_stored":14442496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":5361664,"data_stored":5361664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":9179136,"data_stored":9822208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":10326016,"data_stored":12447744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:40.949 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:40.947+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:41.042 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:41.042 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:41.050 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:41.047+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:41.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:41.152 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:41.149+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:41.180 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:41.180 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:41.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:41.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:41.253 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:41.247+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:41.311 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:41.311 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:41.325 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:41.353 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:41.349+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:41.385 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:41.386 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:41.406 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:41.407 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:41.426 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:41.426 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:41.447 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:41.447 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:41.454 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:41.451+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:41.468 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:41.488 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:41.489 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:41.494 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:41.494 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:41.496 INFO:tasks.rados.rados.0.smithi175.stdout:247: done (2 left) 2024-04-26T02:24:41.496 INFO:tasks.rados.rados.0.smithi175.stdout:248: read oid 22 snap -1 2024-04-26T02:24:41.496 INFO:tasks.rados.rados.0.smithi175.stdout:248: expect (ObjNum 97 snap 13 seq_num 97) 2024-04-26T02:24:41.496 INFO:tasks.rados.rados.0.smithi175.stdout:249: read oid 44 snap 15 2024-04-26T02:24:41.496 INFO:tasks.rados.rados.0.smithi175.stdout:249: expect (ObjNum 101 snap 13 seq_num 101) 2024-04-26T02:24:41.496 INFO:tasks.rados.rados.0.smithi175.stdout:250: copy_from oid 23 from oid 33 current snap is 22 2024-04-26T02:24:41.496 INFO:tasks.rados.rados.0.smithi175.stdout:251: snap_remove snap 16 2024-04-26T02:24:41.505 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:24:41.509 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:41.524 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:41.524 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:41.546 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:41.546 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:41.555 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:41.551+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:41.563 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:41.584 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:41.584 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:41.603 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:41.625 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:41.645 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:41.646 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:41.656 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:41.651+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:41.666 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:41.666 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:41.673 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:41.674 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:41.688 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:41.689 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:41.689 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:41.710 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:41.710 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:41.757 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:41.751+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:41.811 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:41.811 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:41.811 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:41.811 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:41.811 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:41.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:41.866 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:41.863+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:41.959 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:41.955+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:41.993 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:41.993 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:41.993 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.948248862, 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0085372480000000008, 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:41.994 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041879+0000", 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041880+0000", 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1999999999999998e-07 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041925+0000", 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.4909e-05 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041954+0000", 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8889000000000001e-05 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042023+0000", 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9521000000000001e-05 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042984+0000", 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096037100000000001 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.043008+0000", 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4519e-05 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050324+0000", 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073160580000000003 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.050416+0000", 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2060999999999998e-05 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 48/31 ECSubWrite(tid=91, reqid=client.4589.0:324, at_version=48'22, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:41.998 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.487837+0000", 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.502290330000001, 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097515859999999996, 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487837+0000", 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:41.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487837+0000", 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487838+0000", 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0999999999999998e-07 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487893+0000", 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5262e-05 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487924+0000", 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0614999999999997e-05 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.487952+0000", 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7872999999999999e-05 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.488114+0000", 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016165600000000001 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.001 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.488144+0000", 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0676000000000002e-05 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497496+0000", 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093519529999999997 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497589+0000", 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2841000000000001e-05 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.002 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 48/31 ECSubWrite(tid=92, reqid=client.4589.0:325, at_version=48'23, trim_to=0'0, roll_forward_to=44'20))", 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.489922+0000", 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.500205576999999, 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007745811, 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489922+0000", 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489922+0000", 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489924+0000", 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8899999999999999e-06 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.489971+0000", 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7018999999999998e-05 2024-04-26T02:24:42.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490017+0000", 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5905000000000002e-05 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490040+0000", 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2932999999999999e-05 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490307+0000", 2024-04-26T02:24:42.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026734300000000002 2024-04-26T02:24:42.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490335+0000", 2024-04-26T02:24:42.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7356e-05 2024-04-26T02:24:42.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497606+0000", 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072711829999999996 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.497668+0000", 2024-04-26T02:24:42.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2181999999999995e-05 2024-04-26T02:24:42.008 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 48/31 ECSubWrite(tid=14, reqid=osd.3.0:14, at_version=48'12, trim_to=0'0, roll_forward_to=47'10))", 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.494941269000002, 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079870340000000005, 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495187+0000", 2024-04-26T02:24:42.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495244+0000", 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6628000000000001e-05 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495273+0000", 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9213e-05 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.495297+0000", 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4066e-05 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496180+0000", 2024-04-26T02:24:42.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00088288699999999995 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.496209+0000", 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503084+0000", 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068750599999999997 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503174+0000", 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9926999999999995e-05 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s2 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.860021+0000", 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.130106748999999, 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097130189999999998, 2024-04-26T02:24:42.014 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.860021+0000", 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.860021+0000", 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.860022+0000", 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6000000000000004e-07 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863762+0000", 2024-04-26T02:24:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037407019999999998 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863788+0000", 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5873000000000001e-05 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863806+0000", 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.806e-05 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.863984+0000", 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017777900000000001 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.864014+0000", 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9779000000000001e-05 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.869664+0000", 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056499640000000004 2024-04-26T02:24:42.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.869734+0000", 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0302000000000006e-05 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.019 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 59/31 ECSubWrite(tid=68, reqid=osd.15.0:68, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.558015+0000", 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.432113266, 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074937210000000001, 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558015+0000", 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558015+0000", 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558015+0000", 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.23e-07 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558066+0000", 2024-04-26T02:24:42.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0998999999999997e-05 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558113+0000", 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6295999999999999e-05 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558140+0000", 2024-04-26T02:24:42.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7572999999999998e-05 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558407+0000", 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026644100000000002 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558434+0000", 2024-04-26T02:24:42.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7273000000000001e-05 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565408+0000", 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0069742349999999996 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565508+0000", 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010008100000000001 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.559175+0000", 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.430952937000001, 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011413924000000001, 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559175+0000", 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559175+0000", 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559176+0000", 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5430000000000001e-06 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559224+0000", 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7655999999999999e-05 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559246+0000", 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382999999999999e-05 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559262+0000", 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.526e-05 2024-04-26T02:24:42.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561563+0000", 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023016949999999999 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561601+0000", 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7302999999999998e-05 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570496+0000", 2024-04-26T02:24:42.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088953690000000002 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570589+0000", 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2714999999999996e-05 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs6 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.562942+0000", 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.427185388, 2024-04-26T02:24:42.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076692380000000001, 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.562942+0000", 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.562942+0000", 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.562943+0000", 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7000000000000004e-07 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.562998+0000", 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4988000000000003e-05 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563029+0000", 2024-04-26T02:24:42.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1157e-05 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563051+0000", 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1756e-05 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563302+0000", 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025131799999999999 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563328+0000", 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5403000000000001e-05 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570430+0000", 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071017429999999998 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570612+0000", 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000182103 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.033 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.565446+0000", 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.424682130000001, 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078232449999999995, 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565446+0000", 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565446+0000", 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565446+0000", 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9700000000000002e-07 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565512+0000", 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6347999999999996e-05 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565543+0000", 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0620000000000002e-05 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565575+0000", 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1596e-05 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565766+0000", 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019179200000000001 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.565795+0000", 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8370000000000001e-05 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573200+0000", 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074049060000000002 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573269+0000", 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9215999999999996e-05 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567325+0000", 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.422802875, 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012833327, 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.038 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.039 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567325+0000", 2024-04-26T02:24:42.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567325+0000", 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567327+0000", 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.903e-06 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567378+0000", 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0754999999999998e-05 2024-04-26T02:24:42.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567405+0000", 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7440000000000002e-05 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567427+0000", 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2013000000000001e-05 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570487+0000", 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003060236 2024-04-26T02:24:42.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570513+0000", 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5503e-05 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580062+0000", 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095491359999999997 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580158+0000", 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6341000000000005e-05 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s5 59/31 ECSubWrite(tid=37, reqid=osd.1.0:37, at_version=59'25, trim_to=0'0, roll_forward_to=51'23))", 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.574929+0000", 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.415198993000001, 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010674529, 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.043 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574929+0000", 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574929+0000", 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574929+0000", 2024-04-26T02:24:42.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0999999999999998e-07 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574977+0000", 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7589000000000001e-05 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574997+0000", 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0239999999999999e-05 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575015+0000", 2024-04-26T02:24:42.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7339000000000001e-05 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576024+0000", 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010092790000000001 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576048+0000", 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3799999999999999e-05 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.046 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585551+0000", 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095029759999999998 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585603+0000", 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2695999999999998e-05 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.047 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 66/31 ECSubWrite(tid=77, reqid=osd.15.0:77, at_version=66'60, trim_to=0'0, roll_forward_to=65'58))", 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.470994+0000", 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.5191338030000008, 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010289817, 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.470994+0000", 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.470994+0000", 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.470994+0000", 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1e-07 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471024+0000", 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9417999999999999e-05 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471040+0000", 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6268000000000001e-05 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471053+0000", 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2617e-05 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471219+0000", 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000166465 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471230+0000", 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0492999999999999e-05 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.481258+0000", 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010028492999999999 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.481284+0000", 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5752999999999999e-05 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.051 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs6 66/31 ECSubWrite(tid=39, reqid=osd.7.0:39, at_version=66'29, trim_to=0'0, roll_forward_to=65'27))", 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.473389+0000", 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.5167384629999994, 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0090519840000000008, 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473389+0000", 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473389+0000", 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473390+0000", 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9999999999999998e-07 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473416+0000", 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6016999999999998e-05 2024-04-26T02:24:42.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473431+0000", 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4848000000000001e-05 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473442+0000", 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1681999999999999e-05 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473556+0000", 2024-04-26T02:24:42.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000113633 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473564+0000", 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9289999999999998e-06 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482398+0000", 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088344289999999995 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482441+0000", 2024-04-26T02:24:42.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3046000000000001e-05 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.473959+0000", 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.5161688259999995, 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008785915, 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473959+0000", 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473959+0000", 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.473959+0000", 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0499999999999999e-07 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.474009+0000", 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9502999999999997e-05 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.474274+0000", 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026536700000000002 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.474289+0000", 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4470999999999999e-05 2024-04-26T02:24:42.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.474405+0000", 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116042 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.474416+0000", 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1601e-05 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482706+0000", 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082891579999999996 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482745+0000", 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9368e-05 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.475472+0000", 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 8.5146557250000008, 2024-04-26T02:24:42.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075112379999999999, 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475472+0000", 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475472+0000", 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475473+0000", 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2200000000000003e-07 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475494+0000", 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0653999999999999e-05 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475506+0000", 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2892e-05 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475514+0000", 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7919999999999993e-06 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475586+0000", 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1841999999999994e-05 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475598+0000", 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1612e-05 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482952+0000", 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073540619999999998 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482983+0000", 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1562e-05 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.064 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s2 70/31 ECSubWrite(tid=55, reqid=client.4589.0:560, at_version=70'42, trim_to=0'0, roll_forward_to=66'40))", 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.565468+0000", 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.4246600220000003, 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075673980000000004, 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565468+0000", 2024-04-26T02:24:42.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565468+0000", 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565468+0000", 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.37e-07 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566136+0000", 2024-04-26T02:24:42.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00066765599999999998 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566161+0000", 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4839999999999999e-05 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566177+0000", 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6235999999999998e-05 2024-04-26T02:24:42.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566328+0000", 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015128799999999999 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566346+0000", 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7153e-05 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.572948+0000", 2024-04-26T02:24:42.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066020899999999997 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.573035+0000", 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7597999999999997e-05 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:580 3.2s0 3:492e5739:::smithi17529564-20:head [rmxattr UXV`NXQYomt]eTei[ksqfOr_cm in=26b,rmxattr ]Xga]WS^XrRqqrQSfTaoOgSYam_`mPmNXg`tNYmT in=40b,rmxattr cS]cSWa_lh^jVbWphdgpXmgYYcnank`UpmobcZUa in=40b,rmxattr dobiNs^RXTPjhaQtOaipXXfdWQYafcajclaW`TiO in=40b,rmxattr g\\scUhe]\\_jRp^SnXga_\\VtssTTbbaj^cSq\\ffmW in=40b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.596668+0000", 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.3934593719999997, 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097145470000000005, 2024-04-26T02:24:42.069 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 580 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.596668+0000", 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.596668+0000", 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.596672+0000", 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8929999999999998e-06 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.596689+0000", 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6427e-05 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.596723+0000", 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4230000000000003e-05 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.596739+0000", 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6082e-05 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.596889+0000", 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014942800000000001 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.597154+0000", 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026589300000000001 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.599159+0000", 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020047849999999998 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.605494+0000", 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006335177 2024-04-26T02:24:42.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.606133+0000", 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063890400000000003 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.606383+0000", 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024972800000000001 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:590 3.2s0 3:4ada42ed:::smithi17529564-22:head [append 0~0] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:38.486216+0000", 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.5039114040000001, 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010849114999999999, 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 590 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486216+0000", 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486216+0000", 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486220+0000", 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6459999999999999e-06 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486233+0000", 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3033e-05 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486266+0000", 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2879999999999997e-05 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486284+0000", 2024-04-26T02:24:42.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8309999999999999e-05 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486416+0000", 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013197999999999999 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486594+0000", 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000177694 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.487942+0000", 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001347975 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.494608+0000", 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066658780000000001 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.496853+0000", 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022455259999999999 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.497066+0000", 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021219300000000001 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:591 3.2s0 3:4ada42ed:::smithi17529564-22:head [rollback 13] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:38.486316+0000", 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.5038116430000001, 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011841552, 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:42.080 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 591 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486316+0000", 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486316+0000", 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486317+0000", 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.06e-06 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486323+0000", 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2199999999999997e-06 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486355+0000", 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1863000000000003e-05 2024-04-26T02:24:42.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486370+0000", 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4333e-05 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.489701+0000", 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033316040000000002 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.489955+0000", 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025324599999999999 2024-04-26T02:24:42.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.491476+0000", 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001521445 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.495852+0000", 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043765059999999996 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498008+0000", 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021557640000000001 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498158+0000", 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014951100000000001 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:592 3.2s0 3:4ada42ed:::smithi17529564-22:head [append 0~0] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:38.486393+0000", 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.5037347570000001, 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012224664999999999, 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:42.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 592 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486393+0000", 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486393+0000", 2024-04-26T02:24:42.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486394+0000", 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9999999999999996e-07 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486398+0000", 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1169999999999997e-06 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486411+0000", 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3098999999999999e-05 2024-04-26T02:24:42.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486425+0000", 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.377e-05 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.492673+0000", 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006248399 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.492912+0000", 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000238349 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.493844+0000", 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00093213400000000004 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.496260+0000", 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024164830000000001 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498523+0000", 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022631190000000001 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498618+0000", 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4295000000000004e-05 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.090 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.091 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:42.091 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:42.091 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:42.092 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:42.093 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:42.091+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:42.193 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:42.191+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:42.223 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:42.224 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:42.224 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:42.224 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:42.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:42.294 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:42.291+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:42.360 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:42.360 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:42.361 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:42.361 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:42.361 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:42.374 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:42.394 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:42.391+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:42.464 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:24:42.471 INFO:tasks.rados.rados.0.smithi175.stdout:251: done (5 left) 2024-04-26T02:24:42.471 INFO:tasks.rados.rados.0.smithi175.stdout:252: read oid 20 snap 17 2024-04-26T02:24:42.471 INFO:tasks.rados.rados.0.smithi175.stdout:252: expect (ObjNum -1183613632 snap 21952 seq_num 3112318752) 2024-04-26T02:24:42.472 INFO:tasks.rados.rados.0.smithi175.stdout:253: snap_create 2024-04-26T02:24:42.472 INFO:tasks.rados.rados.0.smithi175.stdout:244: expect (ObjNum 108 snap 16 seq_num 108) 2024-04-26T02:24:42.495 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:42.491+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:42.508 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:42.508 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:42.508 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:42.508 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.471970595999998, 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011126728000000001, 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:42.509 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034940+0000", 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.663e-06 2024-04-26T02:24:42.510 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034988+0000", 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7794999999999999e-05 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035017+0000", 2024-04-26T02:24:42.511 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9139e-05 2024-04-26T02:24:42.512 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.512 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.512 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035039+0000", 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2178999999999999e-05 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035616+0000", 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057682000000000002 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035639+0000", 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2915999999999999e-05 2024-04-26T02:24:42.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045974+0000", 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01033568 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046065+0000", 2024-04-26T02:24:42.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0536000000000002e-05 2024-04-26T02:24:42.518 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.518 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.518 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.518 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 55/31 ECSubWrite(tid=116, reqid=client.4589.0:370, at_version=55'47, trim_to=0'0, roll_forward_to=51'45))", 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.485305+0000", 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.021603422999998, 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084221049999999992, 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485305+0000", 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485305+0000", 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485306+0000", 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3e-07 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486017+0000", 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00071061799999999999 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486052+0000", 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4898999999999999e-05 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486075+0000", 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3349999999999998e-05 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486227+0000", 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015204899999999999 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486253+0000", 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6143e-05 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.493628+0000", 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073744689999999998 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.493727+0000", 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9946999999999997e-05 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=132, reqid=osd.12.0:132, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.940809598, 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012148091999999999, 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.523 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566100+0000", 2024-04-26T02:24:42.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5400000000000002e-07 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566148+0000", 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8294999999999998e-05 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566223+0000", 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5108e-05 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566249+0000", 2024-04-26T02:24:42.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6033e-05 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566409+0000", 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015976299999999999 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566436+0000", 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7226e-05 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578152+0000", 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011716358 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578247+0000", 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4854999999999999e-05 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.939968368000001, 2024-04-26T02:24:42.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010768801999999999, 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:24:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566941+0000", 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566993+0000", 2024-04-26T02:24:42.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2308999999999997e-05 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567025+0000", 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1934999999999998e-05 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567047+0000", 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2024000000000001e-05 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.530 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567199+0000", 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000151662 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567223+0000", 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3717e-05 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577442+0000", 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010219257000000001 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.531 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577709+0000", 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000267211 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.939811914, 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014918226, 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567098+0000", 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.463e-06 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567147+0000", 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8551999999999999e-05 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567169+0000", 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2215999999999999e-05 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567188+0000", 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8756000000000001e-05 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571613+0000", 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004424936 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9245000000000001e-05 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581898+0000", 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010246251 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.582015+0000", 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011680699999999999 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.568872+0000", 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.938036970000001, 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086318980000000007, 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.536 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568872+0000", 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568872+0000", 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568874+0000", 2024-04-26T02:24:42.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.826e-06 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568925+0000", 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1245999999999997e-05 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568966+0000", 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1091999999999999e-05 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568987+0000", 2024-04-26T02:24:42.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0777000000000001e-05 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569280+0000", 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029324599999999999 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569305+0000", 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5409e-05 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577424+0000", 2024-04-26T02:24:42.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081182909999999997 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577504+0000", 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0011000000000004e-05 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.936404499, 2024-04-26T02:24:42.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013337598000000001, 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570506+0000", 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.844e-06 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570590+0000", 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3950999999999996e-05 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570623+0000", 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3315999999999997e-05 2024-04-26T02:24:42.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570651+0000", 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7319000000000001e-05 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571614+0000", 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00096303399999999998 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8068999999999998e-05 2024-04-26T02:24:42.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583776+0000", 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012123818999999999 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583842+0000", 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6246000000000002e-05 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.544 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.934044825000001, 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011065805, 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572865+0000", 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9400000000000004e-07 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572920+0000", 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5031999999999998e-05 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572952+0000", 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1992000000000001e-05 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572974+0000", 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1829999999999999e-05 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573193+0000", 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021909100000000001 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573218+0000", 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5363000000000001e-05 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583849+0000", 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010630472 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583930+0000", 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1230999999999995e-05 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=168, reqid=osd.0.0:166, at_version=0'0, trim_to=0'0, roll_forward_to=59'45))", 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.584077+0000", 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.922831577, 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088441200000000005, 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584077+0000", 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584077+0000", 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584079+0000", 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.593e-06 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584103+0000", 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4309999999999999e-05 2024-04-26T02:24:42.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584133+0000", 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0226000000000002e-05 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584157+0000", 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3235999999999999e-05 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584326+0000", 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016970599999999999 2024-04-26T02:24:42.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584352+0000", 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5242999999999999e-05 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592844+0000", 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084922179999999993 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592921+0000", 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7588000000000003e-05 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.552 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=170, reqid=osd.0.0:167, at_version=0'0, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.914502564999999, 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010391315999999999, 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:24:42.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592407+0000", 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5099999999999998e-07 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592430+0000", 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2971000000000001e-05 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592453+0000", 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2988000000000001e-05 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592470+0000", 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6490999999999998e-05 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594588+0000", 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021184369999999999 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594615+0000", 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6835999999999999e-05 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.602725+0000", 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081098209999999997 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.602798+0000", 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2921000000000002e-05 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 59/31 ECSubWrite(tid=47, reqid=osd.11.0:47, at_version=59'36, trim_to=0'0, roll_forward_to=58'32))", 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.914347442, 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009047088, 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.557 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592562+0000", 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0999999999999997e-07 2024-04-26T02:24:42.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592623+0000", 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0588999999999999e-05 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592692+0000", 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8748e-05 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592710+0000", 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:24:42.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592963+0000", 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025237000000000002 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592988+0000", 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4916999999999999e-05 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601500+0000", 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085119800000000006 2024-04-26T02:24:42.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601608+0000", 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010890100000000001 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=171, reqid=osd.0.0:171, at_version=59'77, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.913462062000001, 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010285917, 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.561 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593448+0000", 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.435e-06 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593492+0000", 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3446999999999999e-05 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593546+0000", 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4098999999999998e-05 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593567+0000", 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1435999999999999e-05 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.596136+0000", 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025689850000000002 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.596172+0000", 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6155999999999997e-05 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603019+0000", 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068466730000000002 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603733+0000", 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00071368600000000005 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=173, reqid=osd.0.0:169, at_version=0'0, trim_to=0'0, roll_forward_to=59'47))", 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.594962+0000", 2024-04-26T02:24:42.565 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.911946825999999, 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087491909999999999, 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594962+0000", 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594962+0000", 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594964+0000", 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.99e-06 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594991+0000", 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6740000000000001e-05 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595027+0000", 2024-04-26T02:24:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5994999999999997e-05 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595047+0000", 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0716999999999998e-05 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.596968+0000", 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019206710000000001 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.597001+0000", 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2981999999999997e-05 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603006+0000", 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060045489999999997 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603711+0000", 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00070554700000000005 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=172, reqid=osd.0.0:172, at_version=59'79, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.911816339, 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089727690000000002, 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595093+0000", 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017e-06 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595136+0000", 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2545e-05 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595175+0000", 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9230000000000002e-05 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595194+0000", 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8802000000000001e-05 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.599876+0000", 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046815709999999998 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.599899+0000", 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3608000000000002e-05 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603988+0000", 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040892289999999998 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.604065+0000", 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6767000000000005e-05 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=201, reqid=osd.0.0:201, at_version=66'104, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.476806+0000", 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.0301029320000001, 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085092410000000007, 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476806+0000", 2024-04-26T02:24:42.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476806+0000", 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476807+0000", 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476879+0000", 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2088999999999994e-05 2024-04-26T02:24:42.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476903+0000", 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3941999999999999e-05 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476924+0000", 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1637e-05 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477001+0000", 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6592000000000001e-05 2024-04-26T02:24:42.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477009+0000", 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2570000000000007e-06 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.485218+0000", 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082091419999999991 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.485315+0000", 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6892000000000007e-05 2024-04-26T02:24:42.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 66/31 ECSubWrite(tid=52, reqid=osd.11.0:52, at_version=66'38, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.0153293970000004, 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097978149999999996, 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491580+0000", 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2600000000000001e-07 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491602+0000", 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2365999999999999e-05 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491639+0000", 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6505999999999999e-05 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491659+0000", 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0976e-05 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491789+0000", 2024-04-26T02:24:42.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000129944 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491814+0000", 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4732999999999999e-05 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.501242+0000", 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0094274879999999995 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.501377+0000", 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013557599999999999 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.0129462240000002, 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010380267, 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493964+0000", 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8470000000000001e-06 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494018+0000", 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3158999999999997e-05 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494061+0000", 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3278999999999997e-05 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494103+0000", 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2449e-05 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494599+0000", 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049539600000000005 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494625+0000", 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6075999999999999e-05 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.504220+0000", 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009595091 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.504343+0000", 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012297 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.0126515630000004, 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010850225, 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.586 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494258+0000", 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1069999999999999e-06 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494289+0000", 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0175000000000002e-05 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494320+0000", 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1869999999999998e-05 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494360+0000", 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9952e-05 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496568+0000", 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022078480000000001 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496593+0000", 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4641999999999999e-05 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505054+0000", 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084610469999999993 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505107+0000", 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3584000000000001e-05 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=205, reqid=osd.0.0:205, at_version=66'108, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.0111916799999996, 2024-04-26T02:24:42.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096827960000000005, 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495719+0000", 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7630000000000001e-06 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495769+0000", 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0331999999999999e-05 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495801+0000", 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2089999999999999e-05 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495824+0000", 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2368999999999999e-05 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497475+0000", 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016509960000000001 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497506+0000", 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1126e-05 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505332+0000", 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0078265839999999993 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505400+0000", 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7535999999999998e-05 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=206, reqid=osd.0.0:206, at_version=66'110, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.497463+0000", 2024-04-26T02:24:42.594 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.0094454830000004, 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084321880000000002, 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497463+0000", 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497463+0000", 2024-04-26T02:24:42.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497465+0000", 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6899999999999999e-06 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497523+0000", 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8054999999999999e-05 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497556+0000", 2024-04-26T02:24:42.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2733e-05 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497578+0000", 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.226e-05 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.502654+0000", 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050764410000000001 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.502678+0000", 2024-04-26T02:24:42.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3149000000000001e-05 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505859+0000", 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031814590000000002 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505896+0000", 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6400999999999999e-05 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.598 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:42.599 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:42.599 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:42.600 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:42.601 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:42.597+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:42.701 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:42.695+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:42.761 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:42.761 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:42.761 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:42.762 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:42.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:42.820 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:42.817+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: finishing write tid 1 to smithi17529564-30 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: finishing write tid 2 to smithi17529564-30 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: finishing write tid 3 to smithi17529564-30 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: finishing write tid 4 to smithi17529564-30 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: finishing write tid 5 to smithi17529564-30 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: finishing write tid 6 to smithi17529564-30 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: finishing write tid 7 to smithi17529564-30 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: oid 30 updating version 0 to 75 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: oid 30 version 75 is already newer than 70 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: oid 30 version 75 is already newer than 74 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: oid 30 version 75 is already newer than 72 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: oid 30 version 75 is already newer than 71 2024-04-26T02:24:42.826 INFO:tasks.rados.rados.0.smithi175.stdout:245: oid 30 version 75 is already newer than 73 2024-04-26T02:24:42.827 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 75 (ObjNum 122 snap 22 seq_num 122) dirty exists 2024-04-26T02:24:42.827 INFO:tasks.rados.rados.0.smithi175.stdout:245: left oid 30 (ObjNum 122 snap 22 seq_num 122) 2024-04-26T02:24:42.827 INFO:tasks.rados.rados.0.smithi175.stdout:249: expect (ObjNum 101 snap 13 seq_num 101) 2024-04-26T02:24:42.868 INFO:tasks.rados.rados.0.smithi175.stdout:250: finishing copy_from racing read to smithi17529564-23 2024-04-26T02:24:42.868 INFO:tasks.rados.rados.0.smithi175.stdout:250: finishing copy_from to smithi17529564-23 2024-04-26T02:24:42.868 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 23 v 4 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-04-26T02:24:42.869 INFO:tasks.rados.rados.0.smithi175.stdout:248: expect (ObjNum 97 snap 13 seq_num 97) 2024-04-26T02:24:42.903 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:42.899+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:42.904 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:42.904 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:42.904 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:42.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:42.926 INFO:tasks.rados.rados.0.smithi175.stdout:252: expect (ObjNum -1183613632 snap 21952 seq_num 3112318752) 2024-04-26T02:24:43.004 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:42.999+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:43.045 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:43.045 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:43.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:43.045 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:43.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:406 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~475136] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.247855192999999, 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010860336999999999, 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 406 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794007+0000", 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4770000000000002e-06 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794660+0000", 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065313299999999997 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794694+0000", 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4014999999999999e-05 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794716+0000", 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2846000000000001e-05 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795033+0000", 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000316965 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795302+0000", 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268853 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.797207+0000", 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019045690000000001 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803798+0000", 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006591281 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804729+0000", 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00093087200000000001 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804864+0000", 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013532600000000001 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.050 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:407 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~294912] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.246399309000001, 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010087191000000001, 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 407 2024-04-26T02:24:43.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795462+0000", 2024-04-26T02:24:43.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.674e-06 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795803+0000", 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034131400000000001 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795847+0000", 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4518999999999998e-05 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795869+0000", 2024-04-26T02:24:43.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1892e-05 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.799486+0000", 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0036169510000000002 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.799575+0000", 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8862000000000004e-05 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.800084+0000", 2024-04-26T02:24:43.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00050842200000000002 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803800+0000", 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037168539999999999 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805437+0000", 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001636593 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805547+0000", 2024-04-26T02:24:43.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011011 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:408 3.bs0 3:d145576f:::smithi17529564-17:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.245947521000002, 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010110317000000001, 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.056 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 408 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795913+0000", 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7969999999999999e-06 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795923+0000", 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1970000000000002e-06 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795946+0000", 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3584999999999999e-05 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795962+0000", 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5503999999999999e-05 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.801481+0000", 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005519665 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.801733+0000", 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025184099999999999 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803057+0000", 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013241139999999999 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805141+0000", 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002083175 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805932+0000", 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079104900000000005 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806022+0000", 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0389999999999993e-05 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:409 3.bs0 3:d145576f:::smithi17529564-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.245870729, 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013475743, 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.061 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 409 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:43.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795990+0000", 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.42e-06 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795995+0000", 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5799999999999999e-06 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796017+0000", 2024-04-26T02:24:43.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1778999999999999e-05 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796033+0000", 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6022999999999999e-05 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806706+0000", 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010672472000000001 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806946+0000", 2024-04-26T02:24:43.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024007 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809464+0000", 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025183990000000002 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:413 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~131072] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.228053222, 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011855436, 2024-04-26T02:24:43.065 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 413 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813808+0000", 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0200000000000001e-06 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813887+0000", 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9437999999999994e-05 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813913+0000", 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5082000000000001e-05 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813931+0000", 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.859e-05 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818168+0000", 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042373460000000003 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818314+0000", 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000145289 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819109+0000", 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079474400000000001 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825348+0000", 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062396159999999999 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.069 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825501+0000", 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152583 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825661+0000", 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016072800000000001 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:414 3.bs0 3:db601e58:::smithi17529564-10:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:43.070 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.227896849, 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012515695, 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 414 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:43.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813964+0000", 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.59e-06 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813973+0000", 2024-04-26T02:24:43.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6689999999999995e-06 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813993+0000", 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0440000000000001e-05 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814007+0000", 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4073000000000001e-05 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819880+0000", 2024-04-26T02:24:43.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058725599999999998 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820055+0000", 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017564800000000001 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820866+0000", 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000810299 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826013+0000", 2024-04-26T02:24:43.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051474570000000002 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826385+0000", 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00037209199999999997 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826478+0000", 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2867000000000004e-05 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:415 3.bs0 3:db601e58:::smithi17529564-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.227832415000002, 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014775608000000001, 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 415 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814028+0000", 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2270000000000001e-06 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814034+0000", 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6230000000000002e-06 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814070+0000", 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6513000000000001e-05 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814083+0000", 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.332e-05 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821842+0000", 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077589859999999998 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821934+0000", 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1736000000000004e-05 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826791+0000", 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048572470000000003 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826870+0000", 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8065999999999994e-05 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.828802+0000", 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00193289 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.080 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.473711925, 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01558203, 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568148+0000", 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5300000000000004e-07 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568196+0000", 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8158999999999997e-05 2024-04-26T02:24:43.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568232+0000", 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5565999999999998e-05 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568269+0000", 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568551+0000", 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028192700000000001 2024-04-26T02:24:43.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568576+0000", 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5171999999999999e-05 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583637+0000", 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015060841 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583729+0000", 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2570000000000003e-05 2024-04-26T02:24:43.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.472313308, 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015014527, 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569547+0000", 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-07 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569597+0000", 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0417999999999997e-05 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569626+0000", 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9087000000000001e-05 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569648+0000", 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1869e-05 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569790+0000", 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014197 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569814+0000", 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3748999999999999e-05 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584483+0000", 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014669006 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584560+0000", 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7785000000000001e-05 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.466768630000001, 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010327464999999999, 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.089 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575092+0000", 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575136+0000", 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4712000000000002e-05 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575161+0000", 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4396000000000002e-05 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575179+0000", 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8445999999999999e-05 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575319+0000", 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013968699999999999 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575344+0000", 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5153000000000001e-05 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585327+0000", 2024-04-26T02:24:43.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099826429999999994 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585418+0000", 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1471000000000006e-05 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.466615591, 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012320048, 2024-04-26T02:24:43.093 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575245+0000", 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1039999999999999e-06 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575287+0000", 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2122000000000001e-05 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575310+0000", 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3139999999999999e-05 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575328+0000", 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7932e-05 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575669+0000", 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340749 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575694+0000", 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587485+0000", 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01179094 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587564+0000", 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8610999999999997e-05 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:43.097 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.466443827999999, 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013969232, 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:43.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575416+0000", 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6000000000000004e-07 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575457+0000", 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1006e-05 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575475+0000", 2024-04-26T02:24:43.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8280000000000001e-05 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575492+0000", 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6455000000000001e-05 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575788+0000", 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029676700000000003 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575812+0000", 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3866000000000002e-05 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589304+0000", 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013491306999999999 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589385+0000", 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0990999999999998e-05 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.101 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.465549118999999, 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013188284, 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:43.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576312+0000", 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.88e-06 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576362+0000", 2024-04-26T02:24:43.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9518999999999998e-05 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576392+0000", 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0278999999999999e-05 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576413+0000", 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0879000000000001e-05 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576631+0000", 2024-04-26T02:24:43.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000217858 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576656+0000", 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5230000000000001e-05 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589395+0000", 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012739034999999999 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589498+0000", 2024-04-26T02:24:43.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010360400000000001 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=73, reqid=osd.8.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.450539392, 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099689510000000002, 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591321+0000", 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6440000000000001e-06 2024-04-26T02:24:43.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591346+0000", 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4842999999999999e-05 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591374+0000", 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7705999999999999e-05 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591394+0000", 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0003000000000001e-05 2024-04-26T02:24:43.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591560+0000", 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165966 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591587+0000", 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7291999999999999e-05 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601222+0000", 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096350700000000008 2024-04-26T02:24:43.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601289+0000", 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6427000000000006e-05 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:520 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.572457233, 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013039524, 2024-04-26T02:24:43.110 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 520 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469405+0000", 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.993e-06 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469418+0000", 2024-04-26T02:24:43.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2693e-05 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469453+0000", 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5679000000000002e-05 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469482+0000", 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8943000000000001e-05 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469661+0000", 2024-04-26T02:24:43.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000178486 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469674+0000", 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3112000000000001e-05 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473010+0000", 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033360080000000001 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473163+0000", 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000153323 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.474753+0000", 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001589752 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482102+0000", 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073493830000000001 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482270+0000", 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000167176 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482442+0000", 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017197600000000001 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:521 3.bs0 3:db601e58:::smithi17529564-10:head [rollback d] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.572319253, 2024-04-26T02:24:43.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013833965, 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 521 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469541+0000", 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.513e-06 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469548+0000", 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0129999999999996e-06 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469570+0000", 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1146e-05 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469590+0000", 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0089e-05 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469805+0000", 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000215672 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469818+0000", 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2527000000000001e-05 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476615+0000", 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067965919999999997 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476905+0000", 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029089300000000002 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.478553+0000", 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016476380000000001 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482879+0000", 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043259839999999997 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483241+0000", 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036179499999999999 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483374+0000", 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000133103 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:522 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.572212746, 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015161644, 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.122 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 522 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:24:43.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469648+0000", 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.77e-06 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469654+0000", 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.117e-06 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469675+0000", 2024-04-26T02:24:43.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0455e-05 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469692+0000", 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469872+0000", 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017992299999999999 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:43.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469881+0000", 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5959999999999993e-06 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479445+0000", 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095639639999999995 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479611+0000", 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016535200000000001 2024-04-26T02:24:43.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.480621+0000", 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00101044 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482888+0000", 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022665620000000002 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484697+0000", 2024-04-26T02:24:43.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018098109999999999 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484808+0000", 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110754 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5655614329999992, 2024-04-26T02:24:43.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010206114000000001, 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476299+0000", 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9299999999999996e-07 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476352+0000", 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3522e-05 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476382+0000", 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0116000000000001e-05 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476404+0000", 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2135999999999999e-05 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476629+0000", 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022486899999999999 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476656+0000", 2024-04-26T02:24:43.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6176000000000001e-05 2024-04-26T02:24:43.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.486405+0000", 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097497039999999997 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.486504+0000", 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8697999999999996e-05 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5643346030000007, 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013025037999999999, 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477526+0000", 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3e-06 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477587+0000", 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1579000000000001e-05 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477611+0000", 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3560000000000001e-05 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477623+0000", 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2149e-05 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480063+0000", 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024397440000000002 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480088+0000", 2024-04-26T02:24:43.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5295000000000001e-05 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490508+0000", 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010419741 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490550+0000", 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1669999999999999e-05 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.5626877540000006, 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011565971, 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479172+0000", 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9500000000000001e-07 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479197+0000", 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5130000000000002e-05 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479209+0000", 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.15e-05 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479218+0000", 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2199999999999998e-06 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480190+0000", 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00097207200000000004 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480199+0000", 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3739999999999998e-06 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490652+0000", 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010453069000000001 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490737+0000", 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5810999999999995e-05 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.143 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.143 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.143 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:43.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:43.145 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:43.143+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:43.245 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:43.243+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:43.273 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:43.273 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:43.273 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:43.287 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:43.346 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:43.343+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:43.408 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:43.408 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:43.408 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:43.408 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:43.408 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:43.422 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:24:43.447 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:43.443+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:43.474 INFO:tasks.rados.rados.0.smithi175.stdout:244: done (6 left) 2024-04-26T02:24:43.474 INFO:tasks.rados.rados.0.smithi175.stdout:245: done (5 left) 2024-04-26T02:24:43.474 INFO:tasks.rados.rados.0.smithi175.stdout:248: done (4 left) 2024-04-26T02:24:43.474 INFO:tasks.rados.rados.0.smithi175.stdout:249: done (3 left) 2024-04-26T02:24:43.474 INFO:tasks.rados.rados.0.smithi175.stdout:250: done (2 left) 2024-04-26T02:24:43.474 INFO:tasks.rados.rados.0.smithi175.stdout:252: done (1 left) 2024-04-26T02:24:43.474 INFO:tasks.rados.rados.0.smithi175.stdout:253: done (0 left) 2024-04-26T02:24:43.475 INFO:tasks.rados.rados.0.smithi175.stdout:254: copy_from oid 45 from oid 43 current snap is 23 2024-04-26T02:24:43.475 INFO:tasks.rados.rados.0.smithi175.stdout:255: snap_create 2024-04-26T02:24:43.496 INFO:tasks.rados.rados.0.smithi175.stdout:254: finishing copy_from racing read to smithi17529564-45 2024-04-26T02:24:43.498 INFO:tasks.rados.rados.0.smithi175.stdout:254: finishing copy_from to smithi17529564-45 2024-04-26T02:24:43.498 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 45 v 4 (ObjNum 42 snap 0 seq_num 42) dirty exists 2024-04-26T02:24:43.547 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:43.547 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:43.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:43.548 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:43.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.548 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:276 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:43.548 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:43.548 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.385114446999999, 2024-04-26T02:24:43.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015591825, 2024-04-26T02:24:43.548 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.549 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.549 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.549 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.549 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.549 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.549 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 276 2024-04-26T02:24:43.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.550 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:43.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:24:43.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158464+0000", 2024-04-26T02:24:43.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4240000000000003e-06 2024-04-26T02:24:43.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158778+0000", 2024-04-26T02:24:43.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031355400000000001 2024-04-26T02:24:43.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158793+0000", 2024-04-26T02:24:43.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5654e-05 2024-04-26T02:24:43.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158804+0000", 2024-04-26T02:24:43.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0543000000000001e-05 2024-04-26T02:24:43.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158964+0000", 2024-04-26T02:24:43.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015994199999999999 2024-04-26T02:24:43.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.159116+0000", 2024-04-26T02:24:43.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152194 2024-04-26T02:24:43.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161895+0000", 2024-04-26T02:24:43.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027785510000000002 2024-04-26T02:24:43.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173835+0000", 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011940014000000001 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173974+0000", 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000139546 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174052+0000", 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7403000000000004e-05 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:277 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.379394746999999, 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010157334000000001, 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 277 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164179+0000", 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164186+0000", 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-06 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164969+0000", 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00078311199999999998 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165008+0000", 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9104999999999999e-05 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165032+0000", 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4309000000000001e-05 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167127+0000", 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020944959999999999 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167367+0000", 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023982499999999999 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.169580+0000", 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022133669999999999 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173836+0000", 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042559579999999998 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174288+0000", 2024-04-26T02:24:43.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045227899999999998 2024-04-26T02:24:43.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174337+0000", 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8452999999999998e-05 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:278 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~262144] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.378503795, 2024-04-26T02:24:43.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012417243999999999, 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 278 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165070+0000", 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165072+0000", 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.956e-06 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165417+0000", 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034496100000000002 2024-04-26T02:24:43.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165440+0000", 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2768999999999998e-05 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165455+0000", 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4537e-05 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.170890+0000", 2024-04-26T02:24:43.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054354399999999997 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.171115+0000", 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000224634 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.172663+0000", 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001548334 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175132+0000", 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002469073 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.177317+0000", 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021844920000000001 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.177488+0000", 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017104800000000001 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.571 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:279 3.1s0 3:8c97d9d7:::smithi17529564-6:head [setxattr _header (55) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.378096480000004, 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012771915999999999, 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 279 2024-04-26T02:24:43.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165478+0000", 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165479+0000", 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.113e-06 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165484+0000", 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7940000000000002e-06 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165496+0000", 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2388999999999999e-05 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165504+0000", 2024-04-26T02:24:43.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3960000000000006e-06 2024-04-26T02:24:43.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174364+0000", 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088599820000000006 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174434+0000", 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9259999999999998e-05 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174903+0000", 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00046937200000000002 2024-04-26T02:24:43.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175519+0000", 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00061567900000000005 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.178064+0000", 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025453030000000001 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.178250+0000", 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018562799999999999 2024-04-26T02:24:43.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:280 3.1s0 3:8c97d9d7:::smithi17529564-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.378056418, 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018442278999999999, 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.578 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.579 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 280 2024-04-26T02:24:43.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.579 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165519+0000", 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:24:43.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165523+0000", 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9400000000000004e-06 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165535+0000", 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2486e-05 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165546+0000", 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:24:43.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175360+0000", 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098140950000000001 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175447+0000", 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7737000000000004e-05 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179821+0000", 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043734860000000002 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179966+0000", 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014539199999999999 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183960+0000", 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039937430000000001 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.583 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:422 3.1s0 3:80641982:::smithi17529564-25:head [copy-from ver 55] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.711836446, 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.038918576000000003, 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.584 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 422 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831740+0000", 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5440000000000001e-06 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831752+0000", 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2041999999999999e-05 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831781+0000", 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8833999999999999e-05 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831794+0000", 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3349e-05 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831860+0000", 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5356000000000002e-05 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831926+0000", 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6396000000000006e-05 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.859553+0000", 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027626301999999998 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866678+0000", 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007125803 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870520+0000", 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003841952 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870656+0000", 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013599799999999999 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:423 3.1s0 3:80641982:::smithi17529564-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:43.589 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 20.711752605000001, 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.034213080999999999, 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 423 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831827+0000", 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.792e-06 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831839+0000", 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1712000000000001e-05 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831846+0000", 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9199999999999998e-06 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832063+0000", 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021765599999999999 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for blocked object", 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832133+0000", 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9449999999999994e-05 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865896+0000", 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.033763107000000001 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865962+0000", 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5810999999999997e-05 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866035+0000", 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2782999999999998e-05 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:503 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:24:43.594 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.980866923000001, 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019134271000000001, 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 503 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562709+0000", 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1500000000000002e-06 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562720+0000", 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0746e-05 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562740+0000", 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0370999999999999e-05 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562753+0000", 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2561999999999999e-05 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562867+0000", 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113841 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562881+0000", 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3709999999999999e-05 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569080+0000", 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061992339999999996 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569415+0000", 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033499799999999998 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581842+0000", 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012426659 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:504 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:24:43.599 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:24:43.600 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.980794529000001, 2024-04-26T02:24:43.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020273925000000002, 2024-04-26T02:24:43.600 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.600 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.600 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 504 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:24:43.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562781+0000", 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562797+0000", 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6254000000000001e-05 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562809+0000", 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2204e-05 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562818+0000", 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8459999999999997e-06 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562987+0000", 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016880399999999999 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:43.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562997+0000", 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0713000000000001e-05 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570438+0000", 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007440894 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570691+0000", 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025249400000000003 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583054+0000", 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012362720000000001 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:505 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.980740352000002, 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.032520136999999998, 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.605 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 505 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562835+0000", 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0200000000000001e-07 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562839+0000", 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5839999999999996e-06 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562853+0000", 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4216000000000001e-05 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562864+0000", 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0579e-05 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563046+0000", 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018216799999999999 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:43.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563058+0000", 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1378e-05 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571720+0000", 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086620359999999997 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571999+0000", 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027927099999999999 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595354+0000", 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023355102999999999 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpRead(3.1s0 59/31 ECSubRead(tid=44, to_read={3:84b104fd:::smithi17529564-9:head=0,36864,0}, subchunks={3:84b104fd:::smithi17529564-9:head=[0,1]}, attrs_to_read=))", 2024-04-26T02:24:43.610 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.972268349, 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014360293, 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:43.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571606+0000", 2024-04-26T02:24:43.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029980300000000002 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571627+0000", 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1239000000000001e-05 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575588+0000", 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039609429999999998 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585666+0000", 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010078307999999999 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.9s5 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572282+0000", 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.971292515000002, 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083266190000000004, 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572282+0000", 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572282+0000", 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572284+0000", 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0870000000000001e-06 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572311+0000", 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7129000000000001e-05 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572345+0000", 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3809000000000001e-05 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572366+0000", 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1696e-05 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573681+0000", 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013150289999999999 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573709+0000", 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7699e-05 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580525+0000", 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006816328 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580608+0000", 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2842000000000004e-05 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=45, attrs_read=0))", 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574589+0000", 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.968985357000001, 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087970289999999996, 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.618 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.619 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.619 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574589+0000", 2024-04-26T02:24:43.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574589+0000", 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574590+0000", 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0499999999999999e-06 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574679+0000", 2024-04-26T02:24:43.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9362000000000003e-05 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574699+0000", 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0134999999999999e-05 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574713+0000", 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3164e-05 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583295+0000", 2024-04-26T02:24:43.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085828369999999994 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583386+0000", 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0481000000000003e-05 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=45, attrs_read=0))", 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.963301181999999, 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015110926, 2024-04-26T02:24:43.622 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584305+0000", 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040320649999999996 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584322+0000", 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7076e-05 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594641+0000", 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010319246000000001 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595384+0000", 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074253899999999996 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.9s5 66/31 ECSubWrite(tid=88, reqid=osd.13.0:88, at_version=66'40, trim_to=0'0, roll_forward_to=65'38))", 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.484979+0000", 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.058594892, 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013256555, 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.484979+0000", 2024-04-26T02:24:43.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.484979+0000", 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.484981+0000", 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.387e-06 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.485027+0000", 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6251999999999997e-05 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.485055+0000", 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7959000000000001e-05 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.485074+0000", 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9097e-05 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.485178+0000", 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010360400000000001 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.485190+0000", 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2456999999999999e-05 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497841+0000", 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012651173999999999 2024-04-26T02:24:43.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.498236+0000", 2024-04-26T02:24:43.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00039462500000000001 2024-04-26T02:24:43.630 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.630 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:560 3.1s0 3:80641982:::smithi17529564-25:head [append 0~770048] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9816536779999998, 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018860572999999999, 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 560 2024-04-26T02:24:43.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561923+0000", 2024-04-26T02:24:43.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9890000000000001e-06 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562755+0000", 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083166800000000003 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562788+0000", 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2960000000000003e-05 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562804+0000", 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5636000000000001e-05 2024-04-26T02:24:43.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562942+0000", 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000138271 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.563116+0000", 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017447599999999999 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.565388+0000", 2024-04-26T02:24:43.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002271295 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574120+0000", 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087317829999999999 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580556+0000", 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006436509 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580781+0000", 2024-04-26T02:24:43.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022498599999999999 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:561 3.1s0 3:80641982:::smithi17529564-25:head [append 0~704512] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.569187+0000", 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9743870020000003, 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012694603, 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.636 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 561 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.569187+0000", 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.569187+0000", 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.569191+0000", 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.844e-06 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.570132+0000", 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000941269 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.570169+0000", 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6426e-05 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.570191+0000", 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2200000000000001e-05 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.570367+0000", 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017610299999999999 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.570647+0000", 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027963800000000002 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.639 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.572737+0000", 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020901180000000002 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.579874+0000", 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0071369759999999997 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581692+0000", 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018185059999999999 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581882+0000", 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018952300000000001 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:562 3.1s0 3:80641982:::smithi17529564-25:head [append 0~458752] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.573254+0000", 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9703197939999999, 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098102759999999997, 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.641 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 562 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.573254+0000", 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.573254+0000", 2024-04-26T02:24:43.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.573257+0000", 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8439999999999998e-06 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.573964+0000", 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000707196 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.573999+0000", 2024-04-26T02:24:43.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4270000000000002e-05 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574020+0000", 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1605999999999999e-05 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574619+0000", 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00059851800000000003 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574825+0000", 2024-04-26T02:24:43.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020614299999999999 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.576351+0000", 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0015262489999999999 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.579998+0000", 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0036466910000000001 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.582890+0000", 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0028919689999999999 2024-04-26T02:24:43.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.583065+0000", 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017479 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:563 3.1s0 3:80641982:::smithi17529564-25:head [setxattr _header (57) in=7b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.574058+0000", 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9695159950000001, 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012162671999999999, 2024-04-26T02:24:43.646 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 563 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574058+0000", 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574058+0000", 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574061+0000", 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.503e-06 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574069+0000", 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4859999999999997e-06 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574093+0000", 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4083e-05 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574110+0000", 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6387000000000001e-05 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.577534+0000", 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034242819999999998 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.577814+0000", 2024-04-26T02:24:43.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028012499999999999 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.579126+0000", 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013120289999999999 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581041+0000", 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019152539999999999 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.585806+0000", 2024-04-26T02:24:43.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047647510000000002 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.586221+0000", 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041477199999999999 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:564 3.1s0 3:80641982:::smithi17529564-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.9694411299999999, 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021517379, 2024-04-26T02:24:43.651 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 564 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:43.652 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574135+0000", 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.689e-06 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574143+0000", 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9270000000000005e-06 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:43.653 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574163+0000", 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0392999999999999e-05 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574183+0000", 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0210000000000001e-05 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581120+0000", 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069366829999999999 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:43.654 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581385+0000", 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026519800000000002 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587167+0000", 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057815389999999996 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587435+0000", 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026854500000000003 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.595650+0000", 2024-04-26T02:24:43.655 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082151949999999998 2024-04-26T02:24:43.656 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.656 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.656 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.656 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:43.656 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:43.656 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:43.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:24:43.658 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:43.655+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:43.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:43.758 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:43.753+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:43.786 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:43.786 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:43.786 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:43.800 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:24:43.859 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:43.855+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:43.893 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:43.894 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:43.914 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:43.915 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:43.935 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:43.936 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:43.954 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:43.954 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:43.960 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:43.959+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:43.969 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:43.970 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:43.970 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:43.970 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:43.970 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:43.973 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:43.973 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:43.983 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:24:43.994 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:43.995 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:44.018 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:44.018 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:44.038 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:44.060 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:44.061 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:44.061 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:44.057+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:44.083 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:44.083 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:44.107 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:44.108 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:44.109 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:44.109 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:44.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:44.109 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:44.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.0700158, 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0094430320000000005, 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:44.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035735+0000", 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8330000000000001e-06 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035787+0000", 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2111000000000003e-05 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035818+0000", 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0599000000000003e-05 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035841+0000", 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2889000000000001e-05 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036181+0000", 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340057 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036195+0000", 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4769e-05 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045085+0000", 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088895439999999992 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045176+0000", 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1230000000000006e-05 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.114 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.067586882999997, 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095415010000000008, 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038163+0000", 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7999999999999995e-07 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038217+0000", 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4588e-05 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038250+0000", 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2628e-05 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038274+0000", 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4256e-05 2024-04-26T02:24:44.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038532+0000", 2024-04-26T02:24:44.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025780300000000003 2024-04-26T02:24:44.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038556+0000", 2024-04-26T02:24:44.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3811999999999998e-05 2024-04-26T02:24:44.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047633+0000", 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090777800000000006 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047704+0000", 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0054000000000004e-05 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.120 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.065198465999998, 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089888439999999993, 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.121 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040551+0000", 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6199999999999999e-07 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040593+0000", 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2224000000000001e-05 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040614+0000", 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0746000000000001e-05 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040630+0000", 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6441999999999999e-05 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041176+0000", 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00054610900000000003 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041224+0000", 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7712e-05 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049439+0000", 2024-04-26T02:24:44.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082147729999999999 2024-04-26T02:24:44.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049539+0000", 2024-04-26T02:24:44.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100476 2024-04-26T02:24:44.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.127 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:44.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:44.128 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.065084835999997, 2024-04-26T02:24:44.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087839709999999998, 2024-04-26T02:24:44.128 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.128 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.128 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.129 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:44.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:44.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040665+0000", 2024-04-26T02:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3399999999999998e-07 2024-04-26T02:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040718+0000", 2024-04-26T02:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2923999999999997e-05 2024-04-26T02:24:44.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040748+0000", 2024-04-26T02:24:44.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0709e-05 2024-04-26T02:24:44.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040771+0000", 2024-04-26T02:24:44.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2636000000000001e-05 2024-04-26T02:24:44.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041006+0000", 2024-04-26T02:24:44.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023521999999999999 2024-04-26T02:24:44.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.134 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041030+0000", 2024-04-26T02:24:44.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3736000000000001e-05 2024-04-26T02:24:44.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049357+0000", 2024-04-26T02:24:44.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083271030000000006 2024-04-26T02:24:44.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049448+0000", 2024-04-26T02:24:44.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909000000000007e-05 2024-04-26T02:24:44.136 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.136 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.136 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 39.065081566000003, 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012142201, 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:44.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040668+0000", 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2699999999999998e-07 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040700+0000", 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1668999999999998e-05 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040714+0000", 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4517e-05 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040730+0000", 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6030000000000001e-05 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.140 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046667+0000", 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059366619999999997 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046693+0000", 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5769e-05 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052718+0000", 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060254139999999998 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.141 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052810+0000", 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1312999999999998e-05 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:261 3.6s0 3:67e91997:::smithi17529564-21:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.978442665000003, 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097788909999999996, 2024-04-26T02:24:44.142 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 261 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:44.143 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127307+0000", 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2399999999999998e-07 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127310+0000", 2024-04-26T02:24:44.144 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.021e-06 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127316+0000", 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9309999999999996e-06 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127321+0000", 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2020000000000003e-06 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.145 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129502+0000", 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002180586 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129561+0000", 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9558000000000001e-05 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129830+0000", 2024-04-26T02:24:44.146 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268829 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.131759+0000", 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019285280000000001 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.136744+0000", 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049853220000000004 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.137085+0000", 2024-04-26T02:24:44.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034129000000000001 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:262 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.978408801999997, 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013830606, 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:44.148 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 262 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:44.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127341+0000", 2024-04-26T02:24:44.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5300000000000004e-07 2024-04-26T02:24:44.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127343+0000", 2024-04-26T02:24:44.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4399999999999999e-06 2024-04-26T02:24:44.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127349+0000", 2024-04-26T02:24:44.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2369999999999997e-06 2024-04-26T02:24:44.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127356+0000", 2024-04-26T02:24:44.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1600000000000001e-06 2024-04-26T02:24:44.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129990+0000", 2024-04-26T02:24:44.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026331509999999998 2024-04-26T02:24:44.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:44.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.130041+0000", 2024-04-26T02:24:44.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1842999999999998e-05 2024-04-26T02:24:44.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138025+0000", 2024-04-26T02:24:44.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079837410000000008 2024-04-26T02:24:44.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:44.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138259+0000", 2024-04-26T02:24:44.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023420799999999999 2024-04-26T02:24:44.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.161 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.141171+0000", 2024-04-26T02:24:44.161 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029112729999999998 2024-04-26T02:24:44.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.161 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.161 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.161 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.161 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.162 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:273 3.6s0 3:687a1e37:::smithi17529564-28:head [append 0~770048] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:44.162 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:44.162 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.951260789000003, 2024-04-26T02:24:44.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086583819999999992, 2024-04-26T02:24:44.162 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.162 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.162 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:44.163 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:44.163 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:44.163 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:44.163 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 273 2024-04-26T02:24:44.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.163 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154488+0000", 2024-04-26T02:24:44.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.154491+0000", 2024-04-26T02:24:44.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.717e-06 2024-04-26T02:24:44.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155144+0000", 2024-04-26T02:24:44.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065291999999999998 2024-04-26T02:24:44.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155176+0000", 2024-04-26T02:24:44.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2135000000000003e-05 2024-04-26T02:24:44.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155197+0000", 2024-04-26T02:24:44.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1146e-05 2024-04-26T02:24:44.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155809+0000", 2024-04-26T02:24:44.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00061185199999999997 2024-04-26T02:24:44.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:44.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155971+0000", 2024-04-26T02:24:44.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016195700000000001 2024-04-26T02:24:44.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158718+0000", 2024-04-26T02:24:44.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002747453 2024-04-26T02:24:44.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161464+0000", 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00274567 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163030+0000", 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001566121 2024-04-26T02:24:44.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163146+0000", 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011641099999999999 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:274 3.6s0 3:687a1e37:::smithi17529564-28:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.950503595999997, 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090195850000000001, 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:44.173 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:44.174 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:44.174 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 274 2024-04-26T02:24:44.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.174 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:44.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.175 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:44.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155247+0000", 2024-04-26T02:24:44.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4300000000000001e-06 2024-04-26T02:24:44.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155253+0000", 2024-04-26T02:24:44.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0560000000000001e-06 2024-04-26T02:24:44.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155265+0000", 2024-04-26T02:24:44.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2407e-05 2024-04-26T02:24:44.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155275+0000", 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0149000000000001e-05 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160233+0000", 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049580379999999997 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160381+0000", 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000147207 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160878+0000", 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049781399999999996 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163164+0000", 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002285881 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164154+0000", 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00098951799999999999 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164265+0000", 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000111085 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.181 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:275 3.6s0 3:687a1e37:::smithi17529564-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.950433644999997, 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011804706999999999, 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:44.182 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 275 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155316+0000", 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2299999999999999e-07 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155320+0000", 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.49e-06 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155331+0000", 2024-04-26T02:24:44.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.136e-05 2024-04-26T02:24:44.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.185 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.185 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155343+0000", 2024-04-26T02:24:44.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2369e-05 2024-04-26T02:24:44.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162104+0000", 2024-04-26T02:24:44.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067605010000000004 2024-04-26T02:24:44.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162345+0000", 2024-04-26T02:24:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000240669 2024-04-26T02:24:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164877+0000", 2024-04-26T02:24:44.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002532075 2024-04-26T02:24:44.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:44.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165083+0000", 2024-04-26T02:24:44.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020615600000000001 2024-04-26T02:24:44.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167120+0000", 2024-04-26T02:24:44.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020371640000000002 2024-04-26T02:24:44.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.189 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.190 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/31 ECSubWrite(tid=116, reqid=client.4589.0:370, at_version=55'47, trim_to=0'0, roll_forward_to=51'45))", 2024-04-26T02:24:44.191 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:44.191 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.619906581999999, 2024-04-26T02:24:44.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0093206069999999999, 2024-04-26T02:24:44.191 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.191 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.191 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.192 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:44.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485843+0000", 2024-04-26T02:24:44.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2600000000000002e-07 2024-04-26T02:24:44.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486710+0000", 2024-04-26T02:24:44.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000867617 2024-04-26T02:24:44.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486747+0000", 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6479000000000001e-05 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486769+0000", 2024-04-26T02:24:44.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2495999999999999e-05 2024-04-26T02:24:44.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486936+0000", 2024-04-26T02:24:44.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016618899999999999 2024-04-26T02:24:44.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486963+0000", 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6936000000000001e-05 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.495030+0000", 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0080676740000000004 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.495163+0000", 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013269000000000001 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.199 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:383 3.6s0 3:638d7cd2:::smithi17529564-47:head [create,setxattr W^e]Xa\\QrOSaaTXbfV[Shi]\\Y^cPW]lnfeosltRr (1085) in=40b,setxattr hTkl`^NSUgdbSagao\\hnmPXaSYeN_XR_ZOS`cYVa (3368) in=40b,setxattr ]aqlRjO^YXj_kS[PsXNQ_TYdXgp]NOU`fV\\WW^hb (1506) in=40b,setxattr kdYha]pibVahqgkhsYcYR\\VZRjgtrZcTmT[rd[b` (137) in=40b,setxattr d`OriSSVdQdTf^sSVpPZ_ZpT[OcsaUd]o\\Q^NSV_ (1681) in=40b,setxattr pTXSsTp`Zd`WP]lRn_UlYVoVk]WgpokaRqT\\QOVT (840) in=40b,setxattr VWRnm\\bWPesi_gOgOZjOYbUcoegNn_oVpt]tfXZN (1543) in=40b,setxattr NjTckWUfWPjtUi^`Qpkna]XslXbbsZYmntac\\\\Pf (1858) in=40b,setxattr PNV^lSTnchlWZVYSjTNp\\go[aqV]pRX[jOQ\\rpUj (1470) in=40b,setxattr cqphOO\\af\\[Z (19016) in=12b,setxattr ^VrtbXYRWYdcjUfpjhg[]\\cclZfZi^QahnX[rkao (1891) in=40b,setxattr f_m]ncPklgV]akqfe`ZZRaaj[`N_b^TgoOlQnm^S (1507) in=40b,setxattr WiiY]UhUc]i\\WNisQPipi_m^_ftioS_SZfm[Sr[^ (1684) in=40b,setxattr Qla_okbjVjrN]ndRpSq`tX_ggr\\Yipk`[OYX^RfU (631) in=40b,setxattr RpfcObdt_YeTZXfPXcnk^nZqS_iOsqW^Tldl`bZO (1893) in=40b,setxattr l_PpNWgefdZpminrdnZ[kt_YrmrfWdjtoUVea_Qm (6944) in=40b,setxattr esb\\ObrYN[\\TQqi^ZNktnRWtmYZ^coRfNnYirTsa (10104) in=40b,setxattr Q (19016) in=1b,setxattr eoZZNVNjPT[taQ\\TPiheV]pVcrdj[njRRWmhdbjO (8912) in=40b,setxattr Uqkp[eagUe`SeNeNodPjsZ_epZSV_jr[NpWe[Sad (1086) in=40b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:44.199 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.723471+0000", 2024-04-26T02:24:44.200 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.382277564999999, 2024-04-26T02:24:44.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082980250000000005, 2024-04-26T02:24:44.200 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.200 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.200 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:44.200 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:44.200 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:44.201 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:44.201 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 383 2024-04-26T02:24:44.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.201 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723471+0000", 2024-04-26T02:24:44.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723471+0000", 2024-04-26T02:24:44.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723475+0000", 2024-04-26T02:24:44.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9199999999999997e-06 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723538+0000", 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.3207999999999995e-05 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723572+0000", 2024-04-26T02:24:44.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3793e-05 2024-04-26T02:24:44.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723589+0000", 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6296000000000001e-05 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.723752+0000", 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016314899999999999 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.724074+0000", 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032243799999999998 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.726612+0000", 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025379619999999999 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.729410+0000", 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027977620000000001 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.731478+0000", 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020681779999999999 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.731769+0000", 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029131900000000001 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.208 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.533819877999999, 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01458187, 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571930+0000", 2024-04-26T02:24:44.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.08e-06 2024-04-26T02:24:44.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571981+0000", 2024-04-26T02:24:44.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0992000000000002e-05 2024-04-26T02:24:44.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572011+0000", 2024-04-26T02:24:44.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0266000000000001e-05 2024-04-26T02:24:44.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572031+0000", 2024-04-26T02:24:44.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9380000000000001e-05 2024-04-26T02:24:44.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573094+0000", 2024-04-26T02:24:44.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010632339999999999 2024-04-26T02:24:44.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573112+0000", 2024-04-26T02:24:44.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8323000000000001e-05 2024-04-26T02:24:44.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586418+0000", 2024-04-26T02:24:44.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013305783999999999 2024-04-26T02:24:44.216 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.216 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586511+0000", 2024-04-26T02:24:44.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2811000000000003e-05 2024-04-26T02:24:44.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.217 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.217 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.218 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:44.218 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:44.218 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.531348544, 2024-04-26T02:24:44.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012103983, 2024-04-26T02:24:44.218 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.218 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.219 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.219 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:44.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.220 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:44.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574401+0000", 2024-04-26T02:24:44.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:24:44.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574452+0000", 2024-04-26T02:24:44.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0785999999999998e-05 2024-04-26T02:24:44.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574483+0000", 2024-04-26T02:24:44.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1012000000000001e-05 2024-04-26T02:24:44.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574507+0000", 2024-04-26T02:24:44.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3666999999999999e-05 2024-04-26T02:24:44.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574610+0000", 2024-04-26T02:24:44.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010356 2024-04-26T02:24:44.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574620+0000", 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0212e-05 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586431+0000", 2024-04-26T02:24:44.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011810467999999999 2024-04-26T02:24:44.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586504+0000", 2024-04-26T02:24:44.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3558000000000003e-05 2024-04-26T02:24:44.226 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.226 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.0s6 59/31 ECSubWrite(tid=37, reqid=osd.1.0:37, at_version=59'25, trim_to=0'0, roll_forward_to=51'23))", 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.531153785000001, 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01197989, 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.227 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.228 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.228 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:44.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574596+0000", 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.034e-06 2024-04-26T02:24:44.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574638+0000", 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1389e-05 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574659+0000", 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1732000000000001e-05 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574671+0000", 2024-04-26T02:24:44.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1737e-05 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574820+0000", 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014874899999999999 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574845+0000", 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.497e-05 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586519+0000", 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0116744 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586575+0000", 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5878999999999998e-05 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 59/31 ECSubWrite(tid=79, reqid=osd.13.0:77, at_version=0'0, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:44.232 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.529663264, 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015265225, 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576087+0000", 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.33e-07 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576116+0000", 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9782999999999999e-05 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576138+0000", 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1696e-05 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576172+0000", 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3872999999999999e-05 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578894+0000", 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002721986 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578918+0000", 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4042000000000001e-05 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591165+0000", 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012247417 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591351+0000", 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018549500000000001 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.529301046, 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015022990999999999, 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:44.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576450+0000", 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.72e-06 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576517+0000", 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7062000000000003e-05 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576552+0000", 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5466000000000002e-05 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576573+0000", 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0835999999999998e-05 2024-04-26T02:24:44.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576692+0000", 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119474 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576717+0000", 2024-04-26T02:24:44.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5032e-05 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591376+0000", 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014658857000000001 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.242 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591471+0000", 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4543999999999995e-05 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.bs1 59/31 ECSubWrite(tid=32, reqid=osd.7.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=59'21))", 2024-04-26T02:24:44.243 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 17.525592060000001, 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011853449, 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.244 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:44.245 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.245 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.245 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.245 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.245 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:44.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.246 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.246 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.246 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580158+0000", 2024-04-26T02:24:44.246 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5570000000000001e-06 2024-04-26T02:24:44.246 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580183+0000", 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4272000000000001e-05 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580213+0000", 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0003000000000001e-05 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580249+0000", 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5942999999999998e-05 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580419+0000", 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017053200000000001 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580445+0000", 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5452999999999998e-05 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.248 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591931+0000", 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011486194 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592010+0000", 2024-04-26T02:24:44.249 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9494999999999997e-05 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 66/31 ECSubWrite(tid=87, reqid=osd.13.0:87, at_version=66'26, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.482030+0000", 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.623718959, 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085897019999999994, 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482030+0000", 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482030+0000", 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.251 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482031+0000", 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4300000000000002e-07 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482078+0000", 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7496000000000001e-05 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482109+0000", 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1279000000000003e-05 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.252 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.253 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482133+0000", 2024-04-26T02:24:44.253 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3842999999999999e-05 2024-04-26T02:24:44.253 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.253 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.253 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482223+0000", 2024-04-26T02:24:44.254 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9722000000000006e-05 2024-04-26T02:24:44.254 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.254 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.254 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.254 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.482233+0000", 2024-04-26T02:24:44.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0206e-05 2024-04-26T02:24:44.255 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.255 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.255 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.255 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490528+0000", 2024-04-26T02:24:44.255 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082945250000000005 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490620+0000", 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1887999999999998e-05 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 66/31 ECSubWrite(tid=74, reqid=osd.8.0:74, at_version=66'53, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.483974+0000", 2024-04-26T02:24:44.256 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.621774982, 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.008775138, 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.483974+0000", 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.483974+0000", 2024-04-26T02:24:44.257 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.483974+0000", 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7099999999999997e-07 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.483999+0000", 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4348000000000001e-05 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.258 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.484138+0000", 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013904499999999999 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.484148+0000", 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0081000000000001e-05 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.484224+0000", 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6601999999999996e-05 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.484233+0000", 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9770000000000006e-06 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:44.260 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.492656+0000", 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084221890000000001 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.492749+0000", 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3524999999999996e-05 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:44.261 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:44.262 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:44.263 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:44.263 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:44.264 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:44.264 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:24:44.265 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:44.265 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:44.265 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:44.266 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:44.266 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:44.268 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:44.268 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:44.259+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:44.363 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:44.359+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:44.444 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:44.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:24:44.465 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:44.459+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:44.475 INFO:tasks.rados.rados.0.smithi175.stdout:254: done (1 left) 2024-04-26T02:24:44.475 INFO:tasks.rados.rados.0.smithi175.stdout:255: done (0 left) 2024-04-26T02:24:44.475 INFO:tasks.rados.rados.0.smithi175.stdout:256: delete oid 38 current snap is 24 2024-04-26T02:24:44.483 INFO:tasks.rados.rados.0.smithi175.stdout:256: done (0 left) 2024-04-26T02:24:44.484 INFO:tasks.rados.rados.0.smithi175.stdout:257: rmattr oid 46 current snap is 24 2024-04-26T02:24:44.484 INFO:tasks.rados.rados.0.smithi175.stdout:257: done (0 left) 2024-04-26T02:24:44.484 INFO:tasks.rados.rados.0.smithi175.stdout:258: delete oid 17 current snap is 24 2024-04-26T02:24:44.490 INFO:tasks.rados.rados.0.smithi175.stdout:258: done (0 left) 2024-04-26T02:24:44.490 INFO:tasks.rados.rados.0.smithi175.stdout:259: snap_create 2024-04-26T02:24:44.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T02:24:44.566 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:44.563+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:44.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:24:44.668 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:44.663+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:44.761 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:44.762 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:44.768 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:44.765+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:44.776 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:24:44.869 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:44.865+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:44.896 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:44.896 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:44.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:24:44.969 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:44.967+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:45.032 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:45.033 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:45.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:24:45.088 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:45.087+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:45.174 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:45.171+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:45.200 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:45.200 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:45.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:24:45.273 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:45.269+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:45.338 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:45.338 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:45.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:24:45.396 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:45.395+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:45.471 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-04-26T02:24:45.474 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:45.471+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:45.475 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:45.476 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:45.480 INFO:tasks.rados.rados.0.smithi175.stdout:259: done (0 left) 2024-04-26T02:24:45.480 INFO:tasks.rados.rados.0.smithi175.stdout:260: read oid 35 snap -1 2024-04-26T02:24:45.480 INFO:tasks.rados.rados.0.smithi175.stdout:260: expect deleted 2024-04-26T02:24:45.481 INFO:tasks.rados.rados.0.smithi175.stdout:261: rollback oid 39 current snap is 25 2024-04-26T02:24:45.481 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 39 to 17 2024-04-26T02:24:45.481 INFO:tasks.rados.rados.0.smithi175.stdout:262: delete oid 30 current snap is 25 2024-04-26T02:24:45.489 INFO:tasks.rados.rados.0.smithi175.stdout:260: done (2 left) 2024-04-26T02:24:45.489 INFO:tasks.rados.rados.0.smithi175.stdout:262: done (1 left) 2024-04-26T02:24:45.489 INFO:tasks.rados.rados.0.smithi175.stdout:263: snap_create 2024-04-26T02:24:45.491 INFO:tasks.rados.rados.0.smithi175.stdout:261: finishing rollback tid 0 to smithi17529564-39 2024-04-26T02:24:45.493 INFO:tasks.rados.rados.0.smithi175.stdout:261: finishing rollback tid 1 to smithi17529564-39 2024-04-26T02:24:45.495 INFO:tasks.rados.rados.0.smithi175.stdout:261: finishing rollback tid 2 to smithi17529564-39 2024-04-26T02:24:45.495 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 39 v 60 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-04-26T02:24:45.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:24:45.588 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:45.587+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:45.660 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:45.660 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:45.676 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:24:45.677 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:45.673+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:45.777 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:45.775+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:45.842 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:45.842 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:45.858 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:24:45.878 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:45.871+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:45.898 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:45.899 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:45.899 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-04-26T02:24:45.899 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T02:24:45.899 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T02:24:45.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-04-26T02:24:45.979 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:45.975+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:46.022 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:46.022 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T02:24:46.022 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:46.033 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:46.034 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:46.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:24:46.092 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:46.091+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:46.181 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:46.179+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:46.215 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:46.215 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:46.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:24:46.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:46.316 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:46.315+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:46.361 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:46.362 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:46.376 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:24:46.383 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:46.379+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:46.421 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:46.422 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:46.482 INFO:tasks.rados.rados.0.smithi175.stdout:261: done (1 left) 2024-04-26T02:24:46.483 INFO:tasks.rados.rados.0.smithi175.stdout:263: done (0 left) 2024-04-26T02:24:46.483 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 23 current snap is 26 2024-04-26T02:24:46.483 INFO:tasks.rados.rados.0.smithi175.stdout:264: seq_num 126 ranges {540672=573440,1114112=622592,1736704=622592,2359296=311296} 2024-04-26T02:24:46.484 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:46.481+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:46.495 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:46.495 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:46.500 INFO:tasks.rados.rados.0.smithi175.stdout:264: writing smithi17529564-23 from 540672 to 1114112 tid 1 2024-04-26T02:24:46.510 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:24:46.511 INFO:tasks.rados.rados.0.smithi175.stdout:264: writing smithi17529564-23 from 1114112 to 1736704 tid 2 2024-04-26T02:24:46.523 INFO:tasks.rados.rados.0.smithi175.stdout:264: writing smithi17529564-23 from 1736704 to 2359296 tid 3 2024-04-26T02:24:46.528 INFO:tasks.rados.rados.0.smithi175.stdout:264: writing smithi17529564-23 from 2359296 to 2670592 tid 4 2024-04-26T02:24:46.528 INFO:tasks.rados.rados.0.smithi175.stdout:265: snap_create 2024-04-26T02:24:46.528 INFO:tasks.rados.rados.0.smithi175.stdout:264: finishing write tid 1 to smithi17529564-23 2024-04-26T02:24:46.529 INFO:tasks.rados.rados.0.smithi175.stdout:264: finishing write tid 2 to smithi17529564-23 2024-04-26T02:24:46.529 INFO:tasks.rados.rados.0.smithi175.stdout:264: finishing write tid 3 to smithi17529564-23 2024-04-26T02:24:46.534 INFO:tasks.rados.rados.0.smithi175.stdout:264: finishing write tid 4 to smithi17529564-23 2024-04-26T02:24:46.534 INFO:tasks.rados.rados.0.smithi175.stdout:264: finishing write tid 5 to smithi17529564-23 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:264: finishing write tid 6 to smithi17529564-23 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:264: oid 23 updating version 0 to 55 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:264: oid 23 version 55 is already newer than 51 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:264: oid 23 version 55 is already newer than 53 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:264: oid 23 version 55 is already newer than 52 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:264: oid 23 version 55 is already newer than 54 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 23 v 55 (ObjNum 126 snap 26 seq_num 126) dirty exists 2024-04-26T02:24:46.536 INFO:tasks.rados.rados.0.smithi175.stdout:264: left oid 23 (ObjNum 126 snap 26 seq_num 126) 2024-04-26T02:24:46.585 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:46.579+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:46.638 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:46.638 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:46.648 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:46.649 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:46.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:24:46.682 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:46.682 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:46.685 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:46.683+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:46.714 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:46.714 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:46.742 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:46.743 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:46.770 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:46.771 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:46.786 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:46.783+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:46.800 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:46.800 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:46.816 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:46.816 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:46.816 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:46.816 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:46.831 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:24:46.831 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:46.832 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:46.858 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:46.885 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:46.885 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:46.887 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:46.883+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:46.913 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:46.913 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:46.941 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:46.942 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:46.949 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:46.949 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:46.949 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:46.949 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:46.949 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:46.964 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:24:46.965 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:46.965 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:46.988 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:46.985+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:46.990 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:46.990 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:47.015 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:47.015 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:47.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:47.015+0000 7f7f810c3640 0 -- 172.21.15.59:0/1215017362 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f7f7c2262f0 msgr2=0x7f7f7c2286e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:47.039 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:47.087 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:47.087 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:47.087 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:47.087 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:47.087 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.087 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:157 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'111, mlcod=24'105)", 2024-04-26T02:24:47.087 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.653134+0000", 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 58.430877692000003, 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056202459999999997, 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653134+0000", 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653134+0000", 2024-04-26T02:24:47.088 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653136+0000", 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.73e-06 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653148+0000", 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1763000000000001e-05 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653170+0000", 2024-04-26T02:24:47.089 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2665999999999999e-05 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653184+0000", 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3077e-05 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653937+0000", 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00075335400000000002 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:47.090 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.653967+0000", 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9733000000000001e-05 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658661+0000", 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046944309999999998 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.658755+0000", 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3492000000000005e-05 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_repop(client.4260.0:160 1.0 e24/23 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 24'114, mlcod=24'106)", 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:23:48.654930+0000", 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 58.429081955000001, 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059506530000000002, 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654930+0000", 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.092 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654930+0000", 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654931+0000", 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.15e-06 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654942+0000", 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0739e-05 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.093 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654956+0000", 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4503e-05 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.654966+0000", 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4800000000000007e-06 2024-04-26T02:24:47.094 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656141+0000", 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001175557 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.656198+0000", 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6703000000000002e-05 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.660785+0000", 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045868630000000001 2024-04-26T02:24:47.095 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:23:48.660881+0000", 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5657999999999998e-05 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.033981+0000", 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.050031204, 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057967230000000002, 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.096 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033981+0000", 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033981+0000", 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.097 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.033983+0000", 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.99e-06 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034039+0000", 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6436e-05 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034073+0000", 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4233000000000002e-05 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.098 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034097+0000", 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3249999999999999e-05 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034239+0000", 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000142368 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.034261+0000", 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2223000000000001e-05 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.099 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039705+0000", 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054435339999999999 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039778+0000", 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2688999999999995e-05 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.049142564999997, 2024-04-26T02:24:47.100 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073503989999999996, 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034871+0000", 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6700000000000001e-06 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034923+0000", 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1613000000000002e-05 2024-04-26T02:24:47.102 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034958+0000", 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4913000000000003e-05 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.105 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034979+0000", 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1863000000000001e-05 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035130+0000", 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150018 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035154+0000", 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4615999999999999e-05 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.106 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042120+0000", 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069656709999999997 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042220+0000", 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100035 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 38/31 ECSubWrite(tid=70, reqid=osd.0.0:68, at_version=0'0, trim_to=0'0, roll_forward_to=38'14))", 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.055093+0000", 2024-04-26T02:24:47.107 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.028919029000001, 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058012350000000001, 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055093+0000", 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055093+0000", 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.108 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055095+0000", 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.694e-06 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055123+0000", 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.845e-05 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055152+0000", 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8515000000000001e-05 2024-04-26T02:24:47.109 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055173+0000", 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1007000000000001e-05 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055395+0000", 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000222227 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055430+0000", 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5432999999999998e-05 2024-04-26T02:24:47.110 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060792+0000", 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0053617609999999996 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.060894+0000", 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000102148 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.111 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.025983148999998, 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066527089999999997, 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.112 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058037+0000", 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2330000000000006e-06 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058090+0000", 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2769999999999998e-05 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.113 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058122+0000", 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2224999999999997e-05 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058146+0000", 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3924e-05 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058303+0000", 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000157078 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.114 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058328+0000", 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4485999999999999e-05 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064575+0000", 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062476040000000004 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064682+0000", 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000106389 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.115 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.517148178999999, 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085029419999999994, 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566865+0000", 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.023e-06 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566916+0000", 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1465999999999998e-05 2024-04-26T02:24:47.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.118 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.118 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.118 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566933+0000", 2024-04-26T02:24:47.118 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6786000000000002e-05 2024-04-26T02:24:47.118 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.118 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.118 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566944+0000", 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0907000000000001e-05 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569079+0000", 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021353470000000001 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569114+0000", 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4693000000000001e-05 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.119 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575260+0000", 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061455479999999998 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575367+0000", 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000107172 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:47.120 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.514862170000001, 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062937890000000002, 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:24:47.121 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1999999999999999e-07 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569197+0000", 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6388999999999999e-05 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569225+0000", 2024-04-26T02:24:47.122 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7852999999999999e-05 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569246+0000", 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0826999999999999e-05 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569426+0000", 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018082100000000001 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569452+0000", 2024-04-26T02:24:47.123 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5993e-05 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575302+0000", 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058498880000000001 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575444+0000", 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014139799999999999 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.124 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.572514+0000", 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.511498332999999, 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062169570000000004, 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572514+0000", 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.125 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572514+0000", 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572516+0000", 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9700000000000002e-06 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572568+0000", 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1932999999999999e-05 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572599+0000", 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1146000000000003e-05 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572620+0000", 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1625999999999999e-05 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572874+0000", 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025394099999999999 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.127 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572899+0000", 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4862999999999999e-05 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578658+0000", 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057588090000000002 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578731+0000", 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2669000000000005e-05 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.128 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.572658+0000", 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.511354284999999, 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061130250000000002, 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572658+0000", 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.129 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572658+0000", 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572659+0000", 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.68e-06 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572714+0000", 2024-04-26T02:24:47.130 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4756000000000002e-05 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572749+0000", 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5139999999999999e-05 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572771+0000", 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1716999999999999e-05 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573132+0000", 2024-04-26T02:24:47.131 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036077199999999998 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573157+0000", 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5279999999999999e-05 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578545+0000", 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0053882560000000001 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578771+0000", 2024-04-26T02:24:47.132 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000225424 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.510459434000001, 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082705049999999992, 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.133 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.134 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573606+0000", 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602999999999998e-05 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573635+0000", 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8873e-05 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.135 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573660+0000", 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4828999999999999e-05 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575052+0000", 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013921319999999999 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575077+0000", 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5265999999999998e-05 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.136 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581726+0000", 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066491959999999996 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581823+0000", 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6825999999999998e-05 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.505319173, 2024-04-26T02:24:47.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072766089999999999, 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.138 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578694+0000", 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6670000000000001e-06 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578777+0000", 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2946000000000002e-05 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578804+0000", 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6642999999999999e-05 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.139 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578824+0000", 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9962999999999998e-05 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578977+0000", 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015333799999999999 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.140 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579002+0000", 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4490000000000001e-05 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585878+0000", 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006876137 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585969+0000", 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1425e-05 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.141 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 13.608142276000001, 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0078231570000000007, 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:24:47.142 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:24:47.143 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1699999999999997e-07 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475917+0000", 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6984999999999998e-05 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475950+0000", 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2175000000000003e-05 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.144 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.145 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475973+0000", 2024-04-26T02:24:47.145 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3822e-05 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476141+0000", 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000168073 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476167+0000", 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5069e-05 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.146 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483535+0000", 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073683589999999997 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483693+0000", 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015795699999999999 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.147 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 13.607976775999999, 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085944239999999998, 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.148 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476036+0000", 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7699999999999992e-07 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.149 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476086+0000", 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0274e-05 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476109+0000", 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2123000000000001e-05 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476125+0000", 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6804999999999999e-05 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.150 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478426+0000", 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002300814 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478460+0000", 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3671999999999999e-05 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484563+0000", 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006102639 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.151 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484630+0000", 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7119999999999994e-05 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 13.607695111, 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007423453, 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.152 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:24:47.153 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7000000000000005e-07 2024-04-26T02:24:47.154 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.154 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.154 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.154 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476366+0000", 2024-04-26T02:24:47.154 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9001000000000001e-05 2024-04-26T02:24:47.154 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476390+0000", 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3181999999999999e-05 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476410+0000", 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0179000000000001e-05 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476565+0000", 2024-04-26T02:24:47.155 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000155558 2024-04-26T02:24:47.156 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.156 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476591+0000", 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5752e-05 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483658+0000", 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0070671969999999999 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483740+0000", 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2014000000000005e-05 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.157 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 13.606967661000001, 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074208959999999997, 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.158 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.159 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477046+0000", 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7689999999999999e-06 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477094+0000", 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7948000000000002e-05 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477127+0000", 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3052000000000001e-05 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.160 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477149+0000", 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2198999999999999e-05 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478668+0000", 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015185140000000001 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478692+0000", 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4155000000000002e-05 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.161 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.162 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484377+0000", 2024-04-26T02:24:47.162 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056854990000000001 2024-04-26T02:24:47.162 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.162 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.162 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.162 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484465+0000", 2024-04-26T02:24:47.162 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.776e-05 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 66/31 ECSubWrite(tid=74, reqid=osd.8.0:74, at_version=66'53, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 13.600436527999999, 2024-04-26T02:24:47.163 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092472439999999999, 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.164 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483576+0000", 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7400000000000003e-07 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483698+0000", 2024-04-26T02:24:47.165 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122371 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483731+0000", 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2404999999999999e-05 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483769+0000", 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7866e-05 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.166 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484007+0000", 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00023789300000000001 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484030+0000", 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3836e-05 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492725+0000", 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086945890000000008 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.167 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492823+0000", 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7709999999999998e-05 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 66/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=66'22, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:24:47.168 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 13.600249206000001, 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0090347959999999995, 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.169 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483765+0000", 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7770000000000001e-06 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483820+0000", 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5084000000000003e-05 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.170 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483844+0000", 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4788999999999999e-05 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483868+0000", 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3339000000000001e-05 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484151+0000", 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028312500000000001 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.171 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484176+0000", 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4783e-05 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492704+0000", 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085281000000000003 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.172 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492798+0000", 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3799000000000001e-05 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 75/31 ECSubWrite(tid=51, reqid=osd.14.0:51, at_version=75'48, trim_to=0'0, roll_forward_to=74'46))", 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.6106475839999996, 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006684471, 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.173 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:24:47.174 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473365+0000", 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9999999999999997e-07 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473427+0000", 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1585000000000001e-05 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473459+0000", 2024-04-26T02:24:47.175 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473487+0000", 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8306e-05 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473645+0000", 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015791500000000001 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473673+0000", 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7690000000000001e-05 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.479974+0000", 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063010180000000002 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.177 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.480049+0000", 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5020999999999999e-05 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 75/31 ECSubWrite(tid=52, reqid=osd.14.0:52, at_version=75'50, trim_to=0'0, roll_forward_to=74'46))", 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:42.476285+0000", 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.6077264920000003, 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006039249, 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.178 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476285+0000", 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476285+0000", 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.179 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476287+0000", 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.874e-06 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476340+0000", 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2895000000000001e-05 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476394+0000", 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3392e-05 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.180 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476417+0000", 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3506000000000002e-05 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476581+0000", 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016345199999999999 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476607+0000", 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6703000000000002e-05 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.181 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.482232+0000", 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056241859999999998 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.482325+0000", 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3240999999999997e-05 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.182 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.183 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:47.184 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:24:47.185 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:47.183+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:47.285 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:47.279+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:47.310 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:47.310 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:47.311 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:47.311 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:47.324 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:24:47.411 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:47.407+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:47.474 INFO:tasks.rados.rados.0.smithi175.stdout:264: done (1 left) 2024-04-26T02:24:47.475 INFO:tasks.rados.rados.0.smithi175.stdout:265: done (0 left) 2024-04-26T02:24:47.475 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 7 current snap is 27 2024-04-26T02:24:47.475 INFO:tasks.rados.rados.0.smithi175.stdout:266: seq_num 127 ranges {2260992=589824,2850816=753664,3604480=475136,4079616=327680} 2024-04-26T02:24:47.487 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:47.483+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:47.489 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:47.489 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:47.490 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:47.490 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:47.490 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:47.503 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T02:24:47.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:24:47.517 INFO:tasks.rados.rados.0.smithi175.stdout:266: writing smithi17529564-7 from 2260992 to 2850816 tid 1 2024-04-26T02:24:47.528 INFO:tasks.rados.rados.0.smithi175.stdout:266: writing smithi17529564-7 from 2850816 to 3604480 tid 2 2024-04-26T02:24:47.534 INFO:tasks.rados.rados.0.smithi175.stdout:266: writing smithi17529564-7 from 3604480 to 4079616 tid 3 2024-04-26T02:24:47.538 INFO:tasks.rados.rados.0.smithi175.stdout:266: writing smithi17529564-7 from 4079616 to 4407296 tid 4 2024-04-26T02:24:47.538 INFO:tasks.rados.rados.0.smithi175.stdout:267: delete oid 50 current snap is 27 2024-04-26T02:24:47.538 INFO:tasks.rados.rados.0.smithi175.stdout:266: finishing write tid 1 to smithi17529564-7 2024-04-26T02:24:47.542 INFO:tasks.rados.rados.0.smithi175.stdout:266: finishing write tid 2 to smithi17529564-7 2024-04-26T02:24:47.542 INFO:tasks.rados.rados.0.smithi175.stdout:266: finishing write tid 3 to smithi17529564-7 2024-04-26T02:24:47.544 INFO:tasks.rados.rados.0.smithi175.stdout:266: finishing write tid 4 to smithi17529564-7 2024-04-26T02:24:47.545 INFO:tasks.rados.rados.0.smithi175.stdout:266: finishing write tid 5 to smithi17529564-7 2024-04-26T02:24:47.548 INFO:tasks.rados.rados.0.smithi175.stdout:267: done (1 left) 2024-04-26T02:24:47.549 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 16 current snap is 27 2024-04-26T02:24:47.549 INFO:tasks.rados.rados.0.smithi175.stdout:268: seq_num 129 ranges {1589248=622592,2211840=655360,2867200=688128,3555328=212992} 2024-04-26T02:24:47.571 INFO:tasks.rados.rados.0.smithi175.stdout:268: writing smithi17529564-16 from 1589248 to 2211840 tid 1 2024-04-26T02:24:47.578 INFO:tasks.rados.rados.0.smithi175.stdout:268: writing smithi17529564-16 from 2211840 to 2867200 tid 2 2024-04-26T02:24:47.585 INFO:tasks.rados.rados.0.smithi175.stdout:268: writing smithi17529564-16 from 2867200 to 3555328 tid 3 2024-04-26T02:24:47.587 INFO:tasks.rados.rados.0.smithi175.stdout:268: writing smithi17529564-16 from 3555328 to 3768320 tid 4 2024-04-26T02:24:47.588 INFO:tasks.rados.rados.0.smithi175.stdout:269: snap_remove snap 25 2024-04-26T02:24:47.588 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:47.587+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:47.672 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:47.672 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:47.672 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.631649432000003, 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088739449999999994, 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:47.673 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039209+0000", 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.0400000000000005e-07 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.674 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039284+0000", 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.4362000000000004e-05 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039325+0000", 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1119999999999999e-05 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039356+0000", 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0911999999999998e-05 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.675 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039522+0000", 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016579799999999999 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039547+0000", 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4927e-05 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048026+0000", 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0084799690000000004 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.676 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048083+0000", 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6053e-05 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.631445841000001, 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085876479999999998, 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039412+0000", 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039413+0000", 2024-04-26T02:24:47.678 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.037e-06 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039457+0000", 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3426000000000001e-05 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039481+0000", 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4147000000000001e-05 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039502+0000", 2024-04-26T02:24:47.679 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0832999999999999e-05 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039671+0000", 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000169467 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.039696+0000", 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4620000000000001e-05 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.047901+0000", 2024-04-26T02:24:47.680 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082056960000000002 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.048000+0000", 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8422000000000001e-05 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.629096664000002, 2024-04-26T02:24:47.681 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010661271, 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.682 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041762+0000", 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.44e-07 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041818+0000", 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6208999999999997e-05 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.683 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041850+0000", 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041876+0000", 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5426999999999999e-05 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042091+0000", 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021539399999999999 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.684 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042116+0000", 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4403e-05 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052304+0000", 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010188236999999999 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052423+0000", 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011882100000000001 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.685 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.628909235999998, 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012114710000000001, 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.686 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041950+0000", 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.687 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041995+0000", 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4988999999999999e-05 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042019+0000", 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4712999999999999e-05 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042038+0000", 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.688 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045071+0000", 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003033015 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045096+0000", 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4607e-05 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053959+0000", 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088630800000000006 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.689 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054064+0000", 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104576 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 38/31 ECSubWrite(tid=67, reqid=osd.0.0:67, at_version=38'33, trim_to=0'0, roll_forward_to=37'29))", 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.625662206999998, 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088105490000000009, 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.690 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045196+0000", 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.691 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045198+0000", 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7740000000000001e-06 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045280+0000", 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2705000000000002e-05 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045313+0000", 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2483000000000001e-05 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.692 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.045335+0000", 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2316000000000001e-05 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046297+0000", 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00096208100000000005 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.046319+0000", 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2238999999999998e-05 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.693 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053912+0000", 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007592639 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.054006+0000", 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4312000000000001e-05 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.694 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 38/31 ECSubWrite(tid=34, reqid=osd.13.0:34, at_version=38'12, trim_to=0'0, roll_forward_to=37'10))", 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.623729589999996, 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085403059999999992, 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.695 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047128+0000", 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047129+0000", 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047178+0000", 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8572999999999997e-05 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047206+0000", 2024-04-26T02:24:47.696 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8422e-05 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047294+0000", 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.8269000000000005e-05 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047694+0000", 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039957799999999999 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.697 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047729+0000", 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5002999999999997e-05 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055582+0000", 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0078527289999999993 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.055669+0000", 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7025000000000001e-05 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.698 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 65/31 ECSubWrite(tid=198, reqid=osd.0.0:198, at_version=65'102, trim_to=0'0, roll_forward_to=65'98))", 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:32.500660+0000", 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 15.170198243, 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083318960000000001, 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500660+0000", 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.699 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500660+0000", 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500662+0000", 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9829999999999999e-06 2024-04-26T02:24:47.700 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500714+0000", 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2383000000000003e-05 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500745+0000", 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1003000000000001e-05 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.701 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500767+0000", 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1993000000000001e-05 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500914+0000", 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014705499999999999 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.500939+0000", 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5092999999999998e-05 2024-04-26T02:24:47.702 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.508904+0000", 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079645229999999994 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:32.508992+0000", 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7862999999999995e-05 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.703 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 66/31 ECSubWrite(tid=144, reqid=osd.12.0:144, at_version=66'58, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.469865+0000", 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.200993045000001, 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080005819999999991, 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.469865+0000", 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.704 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.469865+0000", 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.469866+0000", 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0299999999999998e-07 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.469917+0000", 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0954e-05 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.705 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.469963+0000", 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6471999999999998e-05 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.469990+0000", 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6605e-05 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.706 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470309+0000", 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031959700000000002 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470333+0000", 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4029e-05 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477759+0000", 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074252500000000004 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.707 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477866+0000", 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010697200000000001 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.200811503000001, 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017047870999999999, 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.708 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.709 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470048+0000", 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.083e-06 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470109+0000", 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1620999999999998e-05 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470135+0000", 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5344999999999999e-05 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.710 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470154+0000", 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9836000000000001e-05 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472084+0000", 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001929343 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472117+0000", 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3411999999999998e-05 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.711 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486997+0000", 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014879618000000001 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.487094+0000", 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7613000000000002e-05 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=201, reqid=osd.0.0:201, at_version=66'104, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:24:47.712 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.194530302, 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012116203000000001, 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.713 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476376+0000", 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7428000000000001e-05 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476400+0000", 2024-04-26T02:24:47.714 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4258999999999999e-05 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476420+0000", 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9656e-05 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476577+0000", 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015684299999999999 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476602+0000", 2024-04-26T02:24:47.715 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5752e-05 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488347+0000", 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011744378999999999 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488444+0000", 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7195999999999996e-05 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.716 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.0s1 66/31 ECSubWrite(tid=49, reqid=osd.1.0:48, at_version=0'0, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.479114+0000", 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.191743912, 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0094050669999999996, 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479114+0000", 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.717 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479114+0000", 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479116+0000", 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.716e-06 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479177+0000", 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1535e-05 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.718 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479202+0000", 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4698999999999998e-05 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479246+0000", 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4115e-05 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.719 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479510+0000", 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026409900000000001 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479535+0000", 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4834999999999999e-05 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488417+0000", 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088821690000000005 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.720 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.721 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488519+0000", 2024-04-26T02:24:47.721 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010189899999999999 2024-04-26T02:24:47.721 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.721 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.722 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.722 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.722 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.722 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:24:47.722 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.191043591, 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010307349, 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.723 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479816+0000", 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479872+0000", 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6118e-05 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.724 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479901+0000", 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9000999999999999e-05 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479922+0000", 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1002999999999999e-05 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480270+0000", 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034741900000000002 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.725 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480293+0000", 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3592e-05 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490051+0000", 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097579220000000005 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490122+0000", 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0541000000000001e-05 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.726 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 66/31 ECSubWrite(tid=87, reqid=osd.13.0:87, at_version=66'26, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.481842+0000", 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.189016260000001, 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0081256109999999996, 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.481842+0000", 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.727 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.481842+0000", 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.481842+0000", 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9700000000000002e-07 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.728 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.481894+0000", 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1820999999999997e-05 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.481925+0000", 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0973000000000003e-05 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.481987+0000", 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2043000000000002e-05 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.729 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482135+0000", 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014808099999999999 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482160+0000", 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5006000000000001e-05 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.489892+0000", 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00773203 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.730 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.489967+0000", 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5259999999999994e-05 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 66/31 ECSubWrite(tid=52, reqid=osd.11.0:52, at_version=66'38, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:47.731 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.17919056, 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014479226, 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:24:47.732 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491668+0000", 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491726+0000", 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8114e-05 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.733 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491758+0000", 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1708999999999997e-05 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491781+0000", 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3102e-05 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491988+0000", 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020686399999999999 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.734 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492015+0000", 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6565999999999999e-05 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506059+0000", 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014044401999999999 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506147+0000", 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7762000000000004e-05 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.735 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 66/31 ECSubWrite(tid=89, reqid=osd.13.0:89, at_version=66'42, trim_to=0'0, roll_forward_to=65'38))", 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.178311799999999, 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013675405999999999, 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.736 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492548+0000", 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7099999999999999e-06 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492635+0000", 2024-04-26T02:24:47.737 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6942999999999997e-05 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493144+0000", 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00050879899999999999 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493171+0000", 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7075000000000001e-05 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.738 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493329+0000", 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015824 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493353+0000", 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4212000000000001e-05 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506165+0000", 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012812161000000001 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.739 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506222+0000", 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6266e-05 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 66/31 ECSubWrite(tid=90, reqid=osd.13.0:87, at_version=0'0, trim_to=0'0, roll_forward_to=66'26))", 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.177284056, 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012679335999999999, 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493576+0000", 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8899999999999999e-06 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.741 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493604+0000", 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7691999999999998e-05 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493653+0000", 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9407999999999999e-05 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493678+0000", 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4966000000000001e-05 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.742 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493892+0000", 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000214494 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493917+0000", 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4229000000000001e-05 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506175+0000", 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012258290999999999 2024-04-26T02:24:47.743 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506253+0000", 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8366000000000002e-05 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.177103364000001, 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015128608, 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.744 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.745 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493756+0000", 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493809+0000", 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2507999999999999e-05 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493837+0000", 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8051999999999998e-05 2024-04-26T02:24:47.746 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493863+0000", 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5559e-05 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495037+0000", 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011746879999999999 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495063+0000", 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5641999999999999e-05 2024-04-26T02:24:47.747 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508808+0000", 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013744869 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508883+0000", 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5537000000000005e-05 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.748 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.176593244999999, 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012858193, 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.749 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494266+0000", 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7099999999999999e-06 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494292+0000", 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5148999999999999e-05 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.750 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494322+0000", 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0052e-05 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494363+0000", 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0825000000000003e-05 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494552+0000", 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018990500000000001 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.751 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494575+0000", 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2969e-05 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.507077+0000", 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012501134000000001 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.507123+0000", 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6449000000000002e-05 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.752 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=205, reqid=osd.0.0:205, at_version=66'108, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.175220012, 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013207474, 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.753 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495640+0000", 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.79e-06 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495692+0000", 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2676999999999997e-05 2024-04-26T02:24:47.754 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495733+0000", 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0098999999999997e-05 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495756+0000", 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3289e-05 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495971+0000", 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021559699999999999 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.755 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495996+0000", 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4975999999999999e-05 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508761+0000", 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012764538000000001 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508845+0000", 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4507999999999998e-05 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.756 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=206, reqid=osd.0.0:206, at_version=66'110, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.174099633000001, 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016729174999999999, 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:47.757 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496760+0000", 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0940000000000002e-06 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:47.758 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496810+0000", 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9588e-05 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496842+0000", 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1780999999999999e-05 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496864+0000", 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.23e-05 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.759 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506108+0000", 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092442960000000008 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506124+0000", 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5327000000000001e-05 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.513404+0000", 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072804300000000001 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:47.760 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.513488+0000", 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3358999999999999e-05 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:47.761 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:47.763 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:24:47.763 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:47.755+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:47.863 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:47.859+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:47.934 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:47.935 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:24:47.935 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:47.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:24:47.991 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:47.987+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:48.065 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:48.063+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:48.117 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:48.117 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:24:48.117 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:24:48.117 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:24:48.118 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:48.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:48.166 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:48.163+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:48.256 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:203 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.219849697999997, 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017435761000000001, 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.257 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 203 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:24:48.258 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033119+0000", 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1899999999999997e-06 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033136+0000", 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7200000000000001e-05 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.259 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033176+0000", 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9603e-05 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033196+0000", 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0492999999999998e-05 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033371+0000", 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000174864 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:24:48.260 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033394+0000", 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043073+0000", 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0096797610000000003 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043333+0000", 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000259602 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.261 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050550+0000", 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072173649999999999 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:204 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:48.262 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.219719075999997, 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019331481000000001, 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.263 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 204 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.264 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033247+0000", 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0870000000000001e-06 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033257+0000", 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8859999999999999e-06 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033277+0000", 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0213000000000001e-05 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.265 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033292+0000", 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4503e-05 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033585+0000", 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029350600000000002 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033603+0000", 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7706999999999998e-05 2024-04-26T02:24:48.266 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044154+0000", 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010550888 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044306+0000", 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000152258 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.052577+0000", 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082704330000000006 2024-04-26T02:24:48.267 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:205 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.219642053999998, 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020334097999999998, 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.268 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 205 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.269 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033324+0000", 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.297e-06 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033333+0000", 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2730000000000008e-06 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033352+0000", 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8768999999999999e-05 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.270 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033369+0000", 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7703999999999999e-05 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033691+0000", 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032162500000000003 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033707+0000", 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6135999999999999e-05 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.271 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047742+0000", 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014034835000000001 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.048005+0000", 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026275300000000001 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053656+0000", 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056517060000000003 2024-04-26T02:24:48.272 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s4 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 42.217956831000002, 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012539899, 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.273 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035008+0000", 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035010+0000", 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.967e-06 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.274 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035065+0000", 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5315999999999997e-05 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035098+0000", 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2839000000000002e-05 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035119+0000", 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1787e-05 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.275 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035327+0000", 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020782 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035341+0000", 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3597e-05 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047462+0000", 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012120743999999999 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.276 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047547+0000", 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.5828999999999994e-05 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:397 3.es0 3:7ba9a40e:::smithi17529564-23:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.477074725000001, 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013103264, 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.277 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 397 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.278 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775890+0000", 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775894+0000", 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1559999999999999e-06 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.279 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775903+0000", 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9709999999999999e-06 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.775912+0000", 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1620000000000008e-06 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.779401+0000", 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00348957 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.280 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.779492+0000", 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0451000000000005e-05 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785914+0000", 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0064220199999999996 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.281 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.785992+0000", 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8082000000000002e-05 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:22.788993+0000", 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0030011320000000001 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.282 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.782586151, 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019654082999999999, 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.283 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470380+0000", 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5370000000000001e-06 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470428+0000", 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8084999999999998e-05 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.284 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470454+0000", 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6611999999999999e-05 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470474+0000", 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9969000000000001e-05 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472365+0000", 2024-04-26T02:24:48.285 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001890978 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472393+0000", 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7518999999999999e-05 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.489955+0000", 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017561729000000002 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.286 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490032+0000", 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7653999999999999e-05 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.474495+0000", 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.778469318999999, 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015822945000000001, 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.287 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474495+0000", 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474495+0000", 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.288 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474496+0000", 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.3e-07 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474555+0000", 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.9154000000000003e-05 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474584+0000", 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9016000000000001e-05 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.289 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474605+0000", 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1585000000000001e-05 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475418+0000", 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00081267700000000004 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475443+0000", 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5004999999999999e-05 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.290 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490242+0000", 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014798438000000001 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490318+0000", 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6440000000000007e-05 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.291 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.777363275000001, 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021524287, 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.292 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475603+0000", 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0260000000000002e-06 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475695+0000", 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1749999999999994e-05 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.293 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475731+0000", 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6205000000000003e-05 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475753+0000", 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1903e-05 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483278+0000", 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075251349999999996 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.294 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483299+0000", 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0865000000000001e-05 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497045+0000", 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013746466000000001 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497125+0000", 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9937000000000004e-05 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.295 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.7s1 66/31 ECSubWrite(tid=26, reqid=osd.3.0:26, at_version=66'24, trim_to=0'0, roll_forward_to=59'22))", 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476961+0000", 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.776003751999999, 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015475533, 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476961+0000", 2024-04-26T02:24:48.296 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476961+0000", 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476961+0000", 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6599999999999996e-07 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477013+0000", 2024-04-26T02:24:48.297 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1737999999999998e-05 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477043+0000", 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9632999999999999e-05 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477065+0000", 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2374999999999998e-05 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.298 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483111+0000", 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060460610000000001 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483137+0000", 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5704999999999999e-05 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492346+0000", 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092095249999999997 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.299 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492436+0000", 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9930000000000001e-05 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s6 66/31 ECSubWrite(tid=21, reqid=osd.14.0:21, at_version=66'20, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.482667+0000", 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.7702969, 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014941464999999999, 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.300 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482667+0000", 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482667+0000", 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482668+0000", 2024-04-26T02:24:48.301 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7599999999999997e-07 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482716+0000", 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7787999999999997e-05 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482748+0000", 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1785000000000001e-05 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482772+0000", 2024-04-26T02:24:48.302 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4073000000000001e-05 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482926+0000", 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015455300000000001 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.482952+0000", 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6176000000000001e-05 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.303 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497325+0000", 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014372609 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497609+0000", 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028390499999999999 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s6 66/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=66'22, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.485176+0000", 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 14.767788152, 2024-04-26T02:24:48.304 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016761895999999998, 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485176+0000", 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485176+0000", 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.305 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485178+0000", 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1069999999999999e-06 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485241+0000", 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2210000000000002e-05 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485275+0000", 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4829000000000001e-05 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.306 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485298+0000", 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2838999999999999e-05 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490440+0000", 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0051415819999999996 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490464+0000", 2024-04-26T02:24:48.307 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4579e-05 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.501854+0000", 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011389720000000001 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.501938+0000", 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4029999999999993e-05 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.308 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:568 3.9s0 3:998d036b:::smithi17529564-5:head [create,setxattr QRSjfcoZhRVnicS[eSPbUc^qrRbNaYScYbZhaamS (1543) in=40b,setxattr Zjrh`qflgPeZldqmsbbVQnalaXbP[b^fsSploSoT (1295) in=40b,setxattr jP`iT\\QlgssrW_ioUenT[sqaW_soZloqTY`i[fdt (1614) in=40b,setxattr SRRc_re`acb]l\\hiakiqT`Z[isftYagZgp^jjTpO (631) in=40b,setxattr ^RSUl^WUXfaRQU]UYNkYZPilQtYXObeOajNUp`^g (1330) in=40b,setxattr othroUQfhqiX`QOWcQN[mahld[dpocs]\\NNqRSbs (1330) in=40b,setxattr o_ngaOZpXtWoqkaf\\gtRU`]eibg]NedssXjSdVio (631) in=40b,setxattr ^^[OYTcRcbV^X^YZXUd[aUhcdnNYtNgXUfqnaaVR (12980) in=40b,setxattr ekmQRY`lpYsdsPOhhcWUrfrfd]gg\\Y\\VdoSSalnV (70) in=40b,setxattr [ie^NP]erYsq`p_Z]sbfVXSXVnQb^Yr\\dZOjXbad (1543) in=40b,setxattr Z]bNbNRemgjYjpNXZ_mPURYPQNOOWQmmtiVqaUca (630) in=40b,setxattr [jVY`Wq[rUN`kr[k`eq^fOUOSk (9612) in=26b,setxattr ni^VZ^jfqWaQcdQTXiWksqd]_apYpa]g\\kPdhPna (419) in=40b,setxattr _tchprYSfT_SpoXkYcVnYriaVUaom\\t_oaRn[PRT (16348) in=40b,setxattr iSNpZnkoptgrQh_Q[dZah\\WlbjqcP\\aO\\\\Ri]Qeh (10804) in=40b,setxattr q\\WNZWjtm_cR``UmY[sWXRemrptfWmf_SZrOgSYY (7228) in=40b,setxattr UoQsk_NkliWsPpkcptQf\\hclfhVnfNjc]qmkkRaO (102) in=40b,setxattr kkhT]jar]PlaVo]lp (9612) in=17b,setxattr cpPdqsOmpSSPOQWQpgi\\\\cmoRWlSfjYeseZacaOs (698) in=40b,setxattr ssPWdiWi[TVTilZ\\TkcllpdTOZemamorRUtUWY__ (14664) in=40b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.676753377000001, 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022811324000000001, 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 568 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.309 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576215+0000", 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7139999999999999e-06 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.310 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576730+0000", 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000515238 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576792+0000", 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2111000000000002e-05 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576817+0000", 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4579e-05 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.311 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576985+0000", 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000168049 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.577007+0000", 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2143000000000001e-05 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.585039+0000", 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080317189999999997 2024-04-26T02:24:48.312 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.585473+0000", 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000434597 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589160+0000", 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0036868180000000001 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595161+0000", 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060015049999999999 2024-04-26T02:24:48.313 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.598839+0000", 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00367717 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.599022+0000", 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018368099999999999 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.314 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:574 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~786432] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.666382332, 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024397418000000001, 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 574 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.315 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586586+0000", 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.76e-06 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.316 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588621+0000", 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020356419999999998 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588663+0000", 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1369000000000003e-05 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588686+0000", 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2702e-05 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.317 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589399+0000", 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071377599999999995 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589701+0000", 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000301682 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.593275+0000", 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035744739999999998 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.318 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.605907+0000", 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012632012999999999 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.610815+0000", 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049077330000000001 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.610979+0000", 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000164267 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.319 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:575 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~458752] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.662023533999999, 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020767264000000001, 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 575 2024-04-26T02:24:48.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.321 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.321 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590950+0000", 2024-04-26T02:24:48.322 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9870000000000005e-06 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592071+0000", 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001121241 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592102+0000", 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1131999999999999e-05 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592121+0000", 2024-04-26T02:24:48.323 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.914e-05 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595884+0000", 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037628990000000001 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596158+0000", 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027422500000000001 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.324 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.598383+0000", 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022244959999999999 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.606145+0000", 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077616789999999996 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611605+0000", 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054602510000000002 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.325 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611708+0000", 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103214 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:576 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~442368] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.595542+0000", 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.657422224999999, 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016866486999999999, 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.326 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 576 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595542+0000", 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595542+0000", 2024-04-26T02:24:48.327 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595559+0000", 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6526000000000001e-05 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596608+0000", 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010493130000000001 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.328 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596663+0000", 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4620999999999998e-05 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596685+0000", 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2374e-05 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.600627+0000", 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039423920000000003 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.329 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.600907+0000", 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027913900000000003 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.603012+0000", 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021058800000000001 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.330 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611291+0000", 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082784680000000006 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.612207+0000", 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00091617100000000002 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.612409+0000", 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020160299999999999 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.331 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:577 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~262144] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.596768+0000", 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.656196164000001, 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016473086000000001, 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 577 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.332 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596768+0000", 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596768+0000", 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596771+0000", 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.576e-06 2024-04-26T02:24:48.333 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597070+0000", 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029942499999999997 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597096+0000", 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6152999999999998e-05 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597117+0000", 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0288999999999998e-05 2024-04-26T02:24:48.334 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.607148+0000", 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010031139 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.607452+0000", 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030462799999999998 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.609717+0000", 2024-04-26T02:24:48.335 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002265001 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611968+0000", 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022506959999999999 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.613083+0000", 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011144060000000001 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.613241+0000", 2024-04-26T02:24:48.336 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015877299999999999 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:578 3.es0 3:7bb6d44f:::smithi17529564-19:head [setxattr _header (57) in=7b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.655817512, 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022171715000000002, 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.337 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 578 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.338 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597149+0000", 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7269999999999999e-06 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597157+0000", 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7299999999999994e-06 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597177+0000", 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9845999999999999e-05 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597199+0000", 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1342999999999999e-05 2024-04-26T02:24:48.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.614157+0000", 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016958498999999998 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.614316+0000", 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015892900000000001 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.615305+0000", 2024-04-26T02:24:48.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00098857200000000006 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.617759+0000", 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024546590000000001 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619160+0000", 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001400517 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619319+0000", 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015889300000000001 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:579 3.es0 3:7bb6d44f:::smithi17529564-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.655745036999999, 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.025841363999999999, 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.343 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 579 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.344 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597221+0000", 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5859999999999999e-06 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597227+0000", 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2600000000000002e-06 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597248+0000", 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0375999999999999e-05 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597263+0000", 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.502e-05 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.616185+0000", 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018922305 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.616447+0000", 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026167300000000003 2024-04-26T02:24:48.346 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619961+0000", 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035144899999999999 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.620208+0000", 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00024693300000000002 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.623061+0000", 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028527209999999999 2024-04-26T02:24:48.347 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:634 3.9s0 3:998264a7:::smithi17529564-45:head [copy-from ver 4] snapc 18=[18,13,11,10] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.7787134089999999, 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024170558000000002, 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.348 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 634 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474254+0000", 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2990000000000001e-06 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474270+0000", 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5486e-05 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474306+0000", 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6508999999999999e-05 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474323+0000", 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7096999999999999e-05 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474491+0000", 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016797599999999999 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474514+0000", 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2308999999999999e-05 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478081+0000", 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035677980000000001 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478236+0000", 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015410900000000001 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.494212+0000", 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015976898999999999 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496990+0000", 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0027779060000000001 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.498291+0000", 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013005130000000001 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.498422+0000", 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013065700000000001 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.353 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:635 3.9s0 3:998264a7:::smithi17529564-45:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.7786058320000002, 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022215378000000001, 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:48.354 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 635 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:24:48.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474360+0000", 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474366+0000", 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.584e-06 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474381+0000", 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4446e-05 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474389+0000", 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7560000000000005e-06 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474652+0000", 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026254000000000002 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474663+0000", 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1382999999999999e-05 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478547+0000", 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038833000000000001 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for blocked object", 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478633+0000", 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6761000000000005e-05 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496261+0000", 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017627779999999999 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496403+0000", 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000141843 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496574+0000", 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000170989 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:24:48.359 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:24:48.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:48.362 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:48.359+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:48.461 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:48.457+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:48.489 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:48.489 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:48.489 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:48.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:48.532 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-04-26T02:24:48.538 INFO:tasks.rados.rados.0.smithi175.stdout:269: done (2 left) 2024-04-26T02:24:48.539 INFO:tasks.rados.rados.0.smithi175.stdout:270: snap_remove snap 17 2024-04-26T02:24:48.562 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:48.557+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:48.622 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:48.622 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:48.622 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:48.636 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:48.663 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:48.659+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:48.765 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:48.763+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.730554026999997, 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075357569999999997, 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.767 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033385+0000", 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4e-07 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033444+0000", 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9450999999999997e-05 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033476+0000", 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1979e-05 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033497+0000", 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0616999999999999e-05 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033684+0000", 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018750700000000001 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033709+0000", 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4912000000000001e-05 2024-04-26T02:24:48.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040833+0000", 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071240510000000002 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040919+0000", 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6399999999999999e-05 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.771 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.729655326, 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010955845000000001, 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034285+0000", 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8669999999999998e-06 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034349+0000", 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4090999999999993e-05 2024-04-26T02:24:48.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034386+0000", 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6511999999999999e-05 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034409+0000", 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3198999999999999e-05 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035470+0000", 2024-04-26T02:24:48.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001061195 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035486+0000", 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5699999999999999e-05 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045121+0000", 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096354679999999995 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045238+0000", 2024-04-26T02:24:48.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011681299999999999 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.725263345999998, 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077721719999999999, 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038675+0000", 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038732+0000", 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024999999999997e-05 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038765+0000", 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2325e-05 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038789+0000", 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4905999999999998e-05 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.778 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039037+0000", 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024744900000000001 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039062+0000", 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4719000000000002e-05 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046357+0000", 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072952980000000004 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046447+0000", 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9690000000000004e-05 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=28, reqid=osd.8.0:28, at_version=37'22, trim_to=0'0, roll_forward_to=37'20))", 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.715953573999997, 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063472160000000001, 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.780 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.781 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:48.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047984+0000", 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047986+0000", 2024-04-26T02:24:48.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9199999999999998e-06 2024-04-26T02:24:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048038+0000", 2024-04-26T02:24:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2228000000000002e-05 2024-04-26T02:24:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048069+0000", 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0719000000000002e-05 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048096+0000", 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6458999999999999e-05 2024-04-26T02:24:48.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048471+0000", 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037564800000000002 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.048496+0000", 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4786e-05 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054242+0000", 2024-04-26T02:24:48.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0057465149999999998 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.054331+0000", 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8941000000000001e-05 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.712722300000003, 2024-04-26T02:24:48.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067178699999999999, 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:48.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051217+0000", 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0099999999999998e-06 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051246+0000", 2024-04-26T02:24:48.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8345999999999999e-05 2024-04-26T02:24:48.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051275+0000", 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8921999999999999e-05 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051313+0000", 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7991999999999998e-05 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051640+0000", 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032731600000000002 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051665+0000", 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4729e-05 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057825+0000", 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061603889999999996 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057933+0000", 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010816599999999999 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.792 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.728789194000001, 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018386527999999999, 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:48.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035150+0000", 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9230000000000001e-06 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035236+0000", 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5860999999999997e-05 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035280+0000", 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3810999999999998e-05 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035303+0000", 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3223000000000001e-05 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035450+0000", 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014687200000000001 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035475+0000", 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4623000000000001e-05 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053426+0000", 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017950875000000002 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053535+0000", 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010933999999999999 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.797 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.722111093000002, 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012671968, 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:48.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041874+0000", 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6728999999999999e-05 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041914+0000", 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0312000000000003e-05 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041939+0000", 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4116000000000001e-05 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042110+0000", 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000171094 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042135+0000", 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.493e-05 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054408+0000", 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012273386000000001 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054499+0000", 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0650999999999997e-05 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.717505701, 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082587159999999993, 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.802 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046434+0000", 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.193e-06 2024-04-26T02:24:48.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046463+0000", 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046509+0000", 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6078000000000002e-05 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046565+0000", 2024-04-26T02:24:48.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6048999999999998e-05 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046730+0000", 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165408 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046747+0000", 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6353000000000001e-05 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054637+0000", 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078899409999999993 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054691+0000", 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4200999999999998e-05 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.806 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 59/31 ECSubWrite(tid=68, reqid=osd.15.0:68, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.557535+0000", 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.206402476000001, 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0063276529999999999, 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557535+0000", 2024-04-26T02:24:48.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557535+0000", 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557536+0000", 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557592+0000", 2024-04-26T02:24:48.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5732000000000001e-05 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557635+0000", 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3118999999999998e-05 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557662+0000", 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7287000000000001e-05 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557848+0000", 2024-04-26T02:24:48.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000185949 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.557876+0000", 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7823000000000001e-05 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563763+0000", 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058871339999999996 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.563863+0000", 2024-04-26T02:24:48.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9821999999999994e-05 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.204954396000002, 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014202093000000001, 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558985+0000", 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.807e-06 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559023+0000", 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7985999999999998e-05 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559047+0000", 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4032999999999998e-05 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559062+0000", 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5082999999999999e-05 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559703+0000", 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064080699999999997 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559728+0000", 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4851999999999999e-05 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573054+0000", 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013325590999999999 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573185+0000", 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131934 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.203420177000002, 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079052459999999995, 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.815 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560592+0000", 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4134999999999994e-05 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560624+0000", 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1325999999999998e-05 2024-04-26T02:24:48.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560647+0000", 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560875+0000", 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022790500000000001 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560900+0000", 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5420000000000001e-05 2024-04-26T02:24:48.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568320+0000", 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074198320000000003 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568423+0000", 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102675 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.819 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.196287928, 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084963339999999995, 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567651+0000", 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567703+0000", 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2142000000000003e-05 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567774+0000", 2024-04-26T02:24:48.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1445000000000005e-05 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567813+0000", 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9026000000000002e-05 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568266+0000", 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045321000000000001 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568294+0000", 2024-04-26T02:24:48.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.743e-05 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576057+0000", 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077626329999999997 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576146+0000", 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9648000000000006e-05 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.19606533, 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014301641, 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567874+0000", 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.19e-06 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567930+0000", 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6505999999999997e-05 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567966+0000", 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5441999999999997e-05 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567986+0000", 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0086999999999999e-05 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569871+0000", 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001885751 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569896+0000", 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4369e-05 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582080+0000", 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012184133999999999 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582174+0000", 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4161999999999997e-05 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.827 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.573867+0000", 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.190071004, 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064014639999999999, 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573867+0000", 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573867+0000", 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573869+0000", 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9199999999999998e-06 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573894+0000", 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5692999999999999e-05 2024-04-26T02:24:48.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573929+0000", 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4566000000000001e-05 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573953+0000", 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3569000000000001e-05 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574373+0000", 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042068900000000002 2024-04-26T02:24:48.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574401+0000", 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8279000000000001e-05 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580205+0000", 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0058032329999999997 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580268+0000", 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3515000000000004e-05 2024-04-26T02:24:48.831 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 59/31 ECSubWrite(tid=38, reqid=osd.1.0:37, at_version=0'0, trim_to=0'0, roll_forward_to=59'25))", 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.588336+0000", 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 22.175601947000001, 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064016409999999996, 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588336+0000", 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588336+0000", 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588338+0000", 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5069999999999999e-06 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588368+0000", 2024-04-26T02:24:48.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9873e-05 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588403+0000", 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4405e-05 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588427+0000", 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4409999999999998e-05 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588574+0000", 2024-04-26T02:24:48.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000147377 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.588599+0000", 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4243000000000002e-05 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.594636+0000", 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060372280000000004 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.594737+0000", 2024-04-26T02:24:48.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101598 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 66/31 ECSubWrite(tid=77, reqid=osd.15.0:77, at_version=66'60, trim_to=0'0, roll_forward_to=65'58))", 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.29263634, 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082262370000000008, 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471302+0000", 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2099999999999998e-07 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471322+0000", 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0667000000000001e-05 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471336+0000", 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.348e-05 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471346+0000", 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6739999999999992e-06 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471519+0000", 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017380499999999999 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471534+0000", 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479481+0000", 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079467189999999997 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479528+0000", 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7051000000000001e-05 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.475579+0000", 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.288358573, 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066513470000000002, 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.840 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475579+0000", 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475579+0000", 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475580+0000", 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0699999999999998e-07 2024-04-26T02:24:48.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475623+0000", 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142000000000001e-05 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475639+0000", 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6562000000000002e-05 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475655+0000", 2024-04-26T02:24:48.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5902000000000001e-05 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475728+0000", 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3313999999999996e-05 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475739+0000", 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0617e-05 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482180+0000", 2024-04-26T02:24:48.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064410969999999998 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482231+0000", 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0405999999999998e-05 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.288254961, 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066723199999999998, 2024-04-26T02:24:48.844 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.82e-07 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475706+0000", 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2748e-05 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475719+0000", 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2520999999999999e-05 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475727+0000", 2024-04-26T02:24:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8249999999999994e-06 2024-04-26T02:24:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.476211+0000", 2024-04-26T02:24:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00048337800000000002 2024-04-26T02:24:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.476227+0000", 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6005999999999999e-05 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482326+0000", 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060991550000000002 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482355+0000", 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9204999999999999e-05 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.850 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=50, reqid=client.4589.0:655, at_version=80'37, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.2377978519999999, 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093202319999999995, 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:24:48.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526141+0000", 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527110+0000", 2024-04-26T02:24:48.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096976099999999997 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527145+0000", 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4860000000000002e-05 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527170+0000", 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5191999999999999e-05 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527416+0000", 2024-04-26T02:24:48.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024589499999999999 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527442+0000", 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6013e-05 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535371+0000", 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079284000000000004 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535460+0000", 2024-04-26T02:24:48.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9450999999999994e-05 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=51, reqid=client.4589.0:656, at_version=80'38, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 1.2326665020000001, 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070853160000000004, 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:48.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531274+0000", 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.497e-06 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531789+0000", 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00051518199999999999 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531821+0000", 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2305999999999999e-05 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531844+0000", 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532644+0000", 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00080051600000000003 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532671+0000", 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6588999999999999e-05 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538264+0000", 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055933129999999999 2024-04-26T02:24:48.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538357+0000", 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2571000000000005e-05 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:48.859 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:48.860 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:48.910 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:48.907+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:48.966 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:48.965+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:48.987 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:48.988 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:48.988 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:48.988 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:49.002 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:49.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:49.090 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:49.087+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:49.168 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:49.163+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:49.168 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:49.168 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:49.168 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:49.169 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:49.169 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:49.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:49.222 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:49.242 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:49.243 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:49.263 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:49.263 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:49.270 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:49.267+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:49.286 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:49.306 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:49.306 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:49.329 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:49.330 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:49.350 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.350 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.427250047000001, 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.073984011000000002, 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918606+0000", 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.396e-06 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918620+0000", 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918641+0000", 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0389000000000001e-05 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918657+0000", 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6671999999999999e-05 2024-04-26T02:24:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918805+0000", 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014724900000000001 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918819+0000", 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4453e-05 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.988816+0000", 2024-04-26T02:24:49.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069997045999999993 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989070+0000", 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025383399999999998 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989371+0000", 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030080500000000002 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.990597+0000", 2024-04-26T02:24:49.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012262740000000001 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992421+0000", 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001824132 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992517+0000", 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5880999999999999e-05 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992587+0000", 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0359999999999997e-05 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.190646917999999, 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017497523000000001, 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.357 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 87 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3300000000000001e-07 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155289+0000", 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1913e-05 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155300+0000", 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1202e-05 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155308+0000", 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000001e-06 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160230+0000", 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049217719999999996 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160358+0000", 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012813700000000001 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160555+0000", 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197207 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163938+0000", 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003382945 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172543+0000", 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086049179999999996 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172636+0000", 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2918999999999996e-05 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172704+0000", 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8007000000000001e-05 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.362 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.190532640999997, 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017505889, 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.363 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 88 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.364 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155322+0000", 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155328+0000", 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2700000000000001e-06 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155358+0000", 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0624999999999999e-05 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155373+0000", 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4229999999999999e-05 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.162973+0000", 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076001050000000002 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163128+0000", 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015489200000000001 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163377+0000", 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024957100000000003 2024-04-26T02:24:49.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.165420+0000", 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020422349999999999 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172717+0000", 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072976839999999996 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172781+0000", 2024-04-26T02:24:49.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3910000000000003e-05 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172827+0000", 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5587000000000002e-05 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.019146546000002, 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018318649999999999, 2024-04-26T02:24:49.369 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 114 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326708+0000", 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9700000000000005e-07 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326713+0000", 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2024-04-26T02:24:49.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326722+0000", 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9199999999999993e-06 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326729+0000", 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1489999999999997e-06 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339956+0000", 2024-04-26T02:24:49.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013227153 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340087+0000", 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130946 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340294+0000", 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206434 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344052+0000", 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037581490000000001 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344900+0000", 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084779500000000004 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344967+0000", 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607000000000005e-05 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345026+0000", 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8146999999999997e-05 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.019113664000002, 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019222108000000002, 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.375 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 115 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:49.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0399999999999995e-07 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326874+0000", 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013342599999999999 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326885+0000", 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1323e-05 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326893+0000", 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7659999999999998e-06 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342112+0000", 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015218537000000001 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342342+0000", 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023057199999999999 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342691+0000", 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034918900000000002 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345831+0000", 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031394740000000002 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345848+0000", 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7686e-05 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345912+0000", 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3709999999999998e-05 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345962+0000", 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9721e-05 2024-04-26T02:24:49.380 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.018942993000003, 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019714167000000001, 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 116 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326911+0000", 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326924+0000", 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2743e-05 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326934+0000", 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5459999999999997e-06 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326941+0000", 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1470000000000004e-06 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344124+0000", 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017183085000000001 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344238+0000", 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114591 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.384 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344425+0000", 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018710800000000001 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345974+0000", 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001548979 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346498+0000", 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052335399999999996 2024-04-26T02:24:49.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346570+0000", 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1983000000000005e-05 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346625+0000", 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4843999999999999e-05 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.018901001000003, 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020133699000000001, 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 117 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.387 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326953+0000", 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.388 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326959+0000", 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.823e-06 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326968+0000", 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9530000000000005e-06 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326979+0000", 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1289e-05 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.389 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345091+0000", 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018111505999999999 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345217+0000", 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012587399999999999 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345409+0000", 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019226700000000001 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.390 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346352+0000", 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00094280000000000004 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346964+0000", 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061192899999999999 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347036+0000", 2024-04-26T02:24:49.391 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2120999999999996e-05 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347086+0000", 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0377000000000002e-05 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.854176314, 2024-04-26T02:24:49.392 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018319485, 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 139 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.393 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491678+0000", 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.333e-06 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491688+0000", 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9299999999999998e-06 2024-04-26T02:24:49.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491707+0000", 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8281999999999999e-05 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491720+0000", 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3502e-05 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504966+0000", 2024-04-26T02:24:49.395 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013245808 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505190+0000", 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000223876 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505520+0000", 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032999 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508527+0000", 2024-04-26T02:24:49.396 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030072739999999999 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509751+0000", 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012241719999999999 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509880+0000", 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128687 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.397 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509997+0000", 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116631 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.854113138000002, 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018559454, 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.398 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 140 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.399 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491742+0000", 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.404e-06 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491946+0000", 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204086 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491967+0000", 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1049000000000001e-05 2024-04-26T02:24:49.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491983+0000", 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6356000000000001e-05 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507052+0000", 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015069173 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507208+0000", 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000155783 2024-04-26T02:24:49.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507411+0000", 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020306 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510024+0000", 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026129 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510123+0000", 2024-04-26T02:24:49.402 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8667999999999998e-05 2024-04-26T02:24:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510230+0000", 2024-04-26T02:24:49.403 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107565 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510300+0000", 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9410000000000001e-05 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.404 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.853842114000003, 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018767703, 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 141 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.405 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492013+0000", 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492039+0000", 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5952000000000002e-05 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492058+0000", 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9215000000000002e-05 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492082+0000", 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4379000000000002e-05 2024-04-26T02:24:49.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508623+0000", 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016540947 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508846+0000", 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022293599999999999 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509201+0000", 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035443900000000001 2024-04-26T02:24:49.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510580+0000", 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013797379999999999 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510627+0000", 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6254000000000001e-05 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510715+0000", 2024-04-26T02:24:49.409 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8215999999999997e-05 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510779+0000", 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4136999999999999e-05 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.410 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.542990183000001, 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018162602999999999, 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 186 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.411 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802865+0000", 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.666e-06 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802876+0000", 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1246e-05 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802898+0000", 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1645999999999999e-05 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802923+0000", 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5389e-05 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.815977+0000", 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013053301 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816115+0000", 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138553 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816319+0000", 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204236 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820746+0000", 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044270739999999996 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820868+0000", 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122127 2024-04-26T02:24:49.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820949+0000", 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0395999999999994e-05 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821026+0000", 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6969000000000001e-05 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.416 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.542904753999998, 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018225614000000001, 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 187 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802950+0000", 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802963+0000", 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3206e-05 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802982+0000", 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8519e-05 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803002+0000", 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0162000000000001e-05 2024-04-26T02:24:49.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816937+0000", 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013934867 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817068+0000", 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130734 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817285+0000", 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000217209 2024-04-26T02:24:49.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820849+0000", 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035643160000000001 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821038+0000", 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000188767 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821122+0000", 2024-04-26T02:24:49.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4243e-05 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821174+0000", 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2181000000000001e-05 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.542808532000002, 2024-04-26T02:24:49.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018460061999999999, 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 188 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803046+0000", 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4500000000000001e-06 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803180+0000", 2024-04-26T02:24:49.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013367300000000001 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803201+0000", 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1399e-05 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803217+0000", 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5556000000000001e-05 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818151+0000", 2024-04-26T02:24:49.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014934374 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818319+0000", 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016765500000000001 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818541+0000", 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022229899999999999 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821196+0000", 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002654965 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821379+0000", 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018284400000000001 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821453+0000", 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3546000000000004e-05 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821505+0000", 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2301e-05 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.542608645999998, 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018840794000000001, 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.428 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803246+0000", 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803257+0000", 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0825999999999999e-05 2024-04-26T02:24:49.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803275+0000", 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8099999999999999e-05 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803288+0000", 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2595999999999999e-05 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819675+0000", 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016387184999999999 2024-04-26T02:24:49.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819800+0000", 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012490999999999999 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820077+0000", 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000277533 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821271+0000", 2024-04-26T02:24:49.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193401 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821965+0000", 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069420199999999999 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822036+0000", 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1119999999999997e-05 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822086+0000", 2024-04-26T02:24:49.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9400999999999997e-05 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:327 3.8s0 3:1859e9b5:::smithi17529564-39:head [create,setxattr `sjUtrS\\bejkdS^PZ^UbhfeR]sl^p__anSUR_aom (1578) in=40b,setxattr Xgg (981) in=3b,setxattr jjU_`S[ao\\\\^aUS`bZo^cefhdeaegSZfc]sS[m[k (631) in=40b,setxattr WptVXs^]ZljihqWVjRTTRsYbpoOd[kede^[d^iNS (15648) in=40b,setxattr NUPa_VdcRWiTY (981) in=13b,setxattr oapqrhbaXndiek^ec[NZPnlNjeX^`^^ht`__ll[g (630) in=40b,setxattr hUokalb_dNqZaP[SZdSptRb]ZndqQTkPSdWpXlg_ (1683) in=40b,setxattr SOaUaOtoOmejUfsqfadVc_\\fpWak\\^nknRQfaXOZ (9120) in=40b,setxattr r[RO_Pl (981) in=7b,setxattr OOd^ZXYi[]NO^mlSkQafkPlVaY`UYcd\\bnaQUZjq (1225) in=40b,setxattr mlY]_qqgYNhaYetZtkgQPN^a^VmW[amS`Qbadgjr (137) in=40b,setxattr iVYdjchT[j\\[\\\\Uto`qnjUcXas^PtqZa^VoRktTT (1823) in=40b,setxattr PhV`]ZkggalnUas (981) in=15b,setxattr [TNbUtYOkT`ZatPerOQOlk\\WahmgadNWaeRZ^YT\\ (1121) in=40b,setxattr aRqq]f]b_cobaZ`ZZRaattjja[X``PaT\\l\\^Y[jU (313) in=40b,setxattr qYXjVRWg (981) in=8b,setxattr cm`nfp^lmRcSZUsStaOg_omiONqeTRWUsOjm]png (1227) in=40b,setxattr _jtbmRhQeZe]nY\\TQctPVagWm[isibp]ooW`hq[Z (1367) in=40b,setxattr _Ybhal\\]RPkmpUPPRRb[_[YfQpj[aXsgkfNbeeOZ (946) in=40b,setxattr YeQo_aSrmVSirmpTkkZqfZaaqOtg\\X\\qoRPrjPai (1786) in=40b] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 33.860251081999998, 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019121231999999998, 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.434 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 327 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485606+0000", 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9339999999999999e-06 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485768+0000", 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162189 2024-04-26T02:24:49.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485811+0000", 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2292000000000001e-05 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485835+0000", 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4182999999999999e-05 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485963+0000", 2024-04-26T02:24:49.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128157 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485976+0000", 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2571999999999999e-05 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490733+0000", 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047575610000000004 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491054+0000", 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032119599999999999 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493981+0000", 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002926484 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503531+0000", 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009550088 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503808+0000", 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027720000000000002 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.504724+0000", 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091537599999999997 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:364 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:49.441 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.883818594000001, 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019186933, 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 364 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:49.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462038+0000", 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6800000000000002e-06 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462048+0000", 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0835999999999999e-05 2024-04-26T02:24:49.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462072+0000", 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3693000000000002e-05 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462089+0000", 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6586e-05 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462283+0000", 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000194496 2024-04-26T02:24:49.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462306+0000", 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2476e-05 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471461+0000", 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091555809999999994 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471729+0000", 2024-04-26T02:24:49.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026759800000000002 2024-04-26T02:24:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.481222+0000", 2024-04-26T02:24:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094929869999999996 2024-04-26T02:24:49.446 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:365 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.883731989000001, 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021296017, 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:49.447 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 365 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462123+0000", 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.39e-06 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462153+0000", 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9685000000000001e-05 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462165+0000", 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2964e-05 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462181+0000", 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5778999999999999e-05 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462501+0000", 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031995299999999999 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462521+0000", 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9715999999999999e-05 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473587+0000", 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01106558 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473802+0000", 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215899 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.483417+0000", 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096150509999999995 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.451 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:366 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.883633408000001, 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022939240999999999, 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:49.452 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 366 2024-04-26T02:24:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462221+0000", 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462229+0000", 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4560000000000003e-06 2024-04-26T02:24:49.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462246+0000", 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7116e-05 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462259+0000", 2024-04-26T02:24:49.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3526999999999999e-05 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462633+0000", 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037355199999999998 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462652+0000", 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9165999999999999e-05 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478081+0000", 2024-04-26T02:24:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015429238 2024-04-26T02:24:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478329+0000", 2024-04-26T02:24:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024798499999999999 2024-04-26T02:24:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.485159+0000", 2024-04-26T02:24:49.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068299909999999997 2024-04-26T02:24:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:508 3.8s0 3:1cc02c30:::smithi17529564-2:head [append 0~606208] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.873448839000002, 2024-04-26T02:24:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018229054000000001, 2024-04-26T02:24:49.465 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 508 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472408+0000", 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0800000000000002e-06 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473853+0000", 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014451850000000001 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473888+0000", 2024-04-26T02:24:49.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4891999999999997e-05 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473913+0000", 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5123e-05 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474093+0000", 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018053700000000001 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:49.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474110+0000", 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6540000000000001e-05 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479082+0000", 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049724280000000001 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479346+0000", 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026396500000000001 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.482004+0000", 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026579569999999999 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.489855+0000", 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078503649999999998 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490489+0000", 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063439499999999995 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490634+0000", 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144587 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:512 3.8s0 3:1cc02c30:::smithi17529564-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.860293224999999, 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017479077999999999, 2024-04-26T02:24:49.472 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 512 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:49.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:49.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485562+0000", 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3e-06 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485569+0000", 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3830000000000003e-06 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485622+0000", 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3565e-05 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485640+0000", 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7416999999999999e-05 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.497174+0000", 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011534342 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.497333+0000", 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015877 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.500226+0000", 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002893446 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.477 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.500351+0000", 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012475499999999999 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.503039+0000", 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026881000000000001 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.478 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:49.479 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:49.479 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:49.480 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:49.480 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:49.481 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:49.482 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:49.482 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:49.483 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:49.483 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:49.483 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:49.484 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:49.484 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:49.485 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:49.475+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:49.496 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:49.497 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:49.520 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:49.521 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:49.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:49.519+0000 7f5ecbfff640 0 -- 172.21.15.59:0/2959407904 >> [v2:172.21.15.142:6809/4003882581,v1:172.21.15.142:6811/4003882581] conn(0x7f5ed421f6f0 msgr2=0x7f5ed4221ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:49.545 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:49.545 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:49.553 INFO:tasks.rados.rados.0.smithi175.stdout:270: done (2 left) 2024-04-26T02:24:49.553 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 8 current snap is 27 2024-04-26T02:24:49.553 INFO:tasks.rados.rados.0.smithi175.stdout:271: seq_num 130 ranges {999424=638976,1638400=671744,2310144=802816,3112960=81920} 2024-04-26T02:24:49.574 INFO:tasks.rados.rados.0.smithi175.stdout:271: writing smithi17529564-8 from 999424 to 1638400 tid 1 2024-04-26T02:24:49.581 INFO:tasks.rados.rados.0.smithi175.stdout:271: writing smithi17529564-8 from 1638400 to 2310144 tid 2 2024-04-26T02:24:49.582 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:49.575+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:49.586 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:49.586 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:49.591 INFO:tasks.rados.rados.0.smithi175.stdout:271: writing smithi17529564-8 from 2310144 to 3112960 tid 3 2024-04-26T02:24:49.593 INFO:tasks.rados.rados.0.smithi175.stdout:271: writing smithi17529564-8 from 3112960 to 3194880 tid 4 2024-04-26T02:24:49.593 INFO:tasks.rados.rados.0.smithi175.stdout:272: copy_from oid 45 from oid 33 current snap is 27 2024-04-26T02:24:49.593 INFO:tasks.rados.rados.0.smithi175.stdout:266: finishing write tid 6 to smithi17529564-7 2024-04-26T02:24:49.593 INFO:tasks.rados.rados.0.smithi175.stdout:266: oid 7 updating version 0 to 37 2024-04-26T02:24:49.593 INFO:tasks.rados.rados.0.smithi175.stdout:266: oid 7 updating version 37 to 38 2024-04-26T02:24:49.593 INFO:tasks.rados.rados.0.smithi175.stdout:266: oid 7 updating version 38 to 41 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:266: oid 7 version 41 is already newer than 39 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:266: oid 7 version 41 is already newer than 40 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 7 v 41 (ObjNum 127 snap 27 seq_num 127) dirty exists 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:266: left oid 7 (ObjNum 127 snap 27 seq_num 127) 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: finishing write tid 1 to smithi17529564-16 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: finishing write tid 2 to smithi17529564-16 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: finishing write tid 3 to smithi17529564-16 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:266: done (3 left) 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:273: copy_from oid 34 from oid 13 current snap is 27 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: finishing write tid 4 to smithi17529564-16 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: finishing write tid 5 to smithi17529564-16 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: finishing write tid 6 to smithi17529564-16 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: oid 16 updating version 0 to 56 2024-04-26T02:24:49.594 INFO:tasks.rados.rados.0.smithi175.stdout:268: oid 16 updating version 56 to 57 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:268: oid 16 updating version 57 to 58 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:268: oid 16 version 58 is already newer than 55 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:268: oid 16 version 58 is already newer than 54 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 16 v 58 (ObjNum 129 snap 27 seq_num 129) dirty exists 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:268: left oid 16 (ObjNum 129 snap 27 seq_num 129) 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:271: finishing write tid 1 to smithi17529564-8 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:268: done (3 left) 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:274: read oid 11 snap -1 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:274: expect deleted 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:275: rollback oid 6 current snap is 27 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 6 to 23 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:271: finishing write tid 2 to smithi17529564-8 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:276: rmattr oid 16 current snap is 27 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:276: done (5 left) 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 49 current snap is 27 2024-04-26T02:24:49.595 INFO:tasks.rados.rados.0.smithi175.stdout:277: seq_num 131 ranges {819200=655360,1474560=425984,1900544=638976,2539520=491520} 2024-04-26T02:24:49.612 INFO:tasks.rados.rados.0.smithi175.stdout:277: writing smithi17529564-49 from 819200 to 1474560 tid 1 2024-04-26T02:24:49.617 INFO:tasks.rados.rados.0.smithi175.stdout:277: writing smithi17529564-49 from 1474560 to 1900544 tid 2 2024-04-26T02:24:49.623 INFO:tasks.rados.rados.0.smithi175.stdout:277: writing smithi17529564-49 from 1900544 to 2539520 tid 3 2024-04-26T02:24:49.628 INFO:tasks.rados.rados.0.smithi175.stdout:277: writing smithi17529564-49 from 2539520 to 3031040 tid 4 2024-04-26T02:24:49.629 INFO:tasks.rados.rados.0.smithi175.stdout:278: snap_remove snap 22 2024-04-26T02:24:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:49.678 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:49.682 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:49.679+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:49.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:49.783 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:49.777+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:49.813 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:49.813 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:49.827 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:49.885 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:49.883+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:49.947 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:49.948 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:49.963 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:49.986 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:49.983+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:50.087 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:50.083+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:50.097 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:50.111 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:50.188 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:50.187+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:50.229 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:50.229 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:50.243 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:50.291 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:50.287+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:50.360 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:50.361 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:50.374 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:50.392 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:50.387+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:50.495 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:50.491+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:50.497 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:50.497 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:50.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:50.552 INFO:tasks.rados.rados.0.smithi175.stdout:278: done (6 left) 2024-04-26T02:24:50.553 INFO:tasks.rados.rados.0.smithi175.stdout:279: snap_remove snap 26 2024-04-26T02:24:50.558 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:24:50.596 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:50.591+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:50.638 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:50.638 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:50.652 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:50.697 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:50.691+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:50.798 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:50.795+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:50.819 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:50.820 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:50.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:50.899 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:50.895+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:50.957 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:50.957 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:50.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:51.000 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:50.995+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:51.038 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:51.038 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:51.038 INFO:tasks.thrashosds.thrasher:Shrinking pool unique_pool_0 2024-04-26T02:24:51.038 INFO:tasks.ceph.ceph_manager.ceph:contract_pool unique_pool_0 by 10 min 16 2024-04-26T02:24:51.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:51.097 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:51.097 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:51.100 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:51.099+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:51.111 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:51.201 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:51.199+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:51.233 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:51.233 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:51.248 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:51.302 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:51.299+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:51.350 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:51.351 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:51.368 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-04-26T02:24:50.725340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":97337888,"num_objects":74,"num_object_clones":26,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":6,"num_read":418,"num_read_kb":91003,"num_write":784,"num_write_kb":107620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":970,"ondisk_log_size":970,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":638948,"kb_used_data":177420,"kb_used_omap":24,"kb_used_meta":461223,"kb_avail":1509310492,"statfs":{"total":1546188226560,"available":1545533943808,"internally_reserved":0,"allocated":181678080,"data_stored":219958573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":472292435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5668864,"num_objects":7,"num_object_clones":7,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":3,"num_read":9,"num_read_kb":125,"num_write":17,"num_write_kb":4912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001231"},"pg_stats":[{"pgid":"3.f","version":"81'60","reported_seq":311,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T02:24:48.674114+0000","last_change":"2024-04-26T02:24:48.676335+0000","last_active":"2024-04-26T02:24:48.674114+0000","last_peered":"2024-04-26T02:24:48.674114+0000","last_clean":"2024-04-26T02:24:48.674114+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:48.674114+0000","last_undegraded":"2024-04-26T02:24:48.674114+0000","last_fullsized":"2024-04-26T02:24:48.674114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.756420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010893336,"stat_sum":{"num_bytes":8323072,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":9131,"num_write":29,"num_write_kb":10064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"17","length":"1"},{"start":"1b","length":"1"}]},{"pgid":"3.e","version":"79'55","reported_seq":287,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.534512+0000","last_change":"2024-04-26T02:24:42.487724+0000","last_active":"2024-04-26T02:24:46.534512+0000","last_peered":"2024-04-26T02:24:46.534512+0000","last_clean":"2024-04-26T02:24:46.534512+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:46.534512+0000","last_undegraded":"2024-04-26T02:24:46.534512+0000","last_fullsized":"2024-04-26T02:24:46.534512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.991738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018434881,"stat_sum":{"num_bytes":6438912,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":1007,"num_write":44,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"3.d","version":"78'85","reported_seq":331,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T02:24:48.672613+0000","last_change":"2024-04-26T02:24:48.673403+0000","last_active":"2024-04-26T02:24:48.672613+0000","last_peered":"2024-04-26T02:24:48.672613+0000","last_clean":"2024-04-26T02:24:48.672613+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:48.672613+0000","last_undegraded":"2024-04-26T02:24:48.672613+0000","last_fullsized":"2024-04-26T02:24:48.672613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.745657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012528909999999999,"stat_sum":{"num_bytes":15384576,"num_objects":8,"num_object_clones":3,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":29,"num_read_kb":4623,"num_write":66,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"17","length":"1"},{"start":"1b","length":"1"}]},{"pgid":"3.c","version":"81'126","reported_seq":378,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T02:24:48.674610+0000","last_change":"2024-04-26T02:24:48.676346+0000","last_active":"2024-04-26T02:24:48.674610+0000","last_peered":"2024-04-26T02:24:48.674610+0000","last_clean":"2024-04-26T02:24:48.674610+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:48.674610+0000","last_undegraded":"2024-04-26T02:24:48.674610+0000","last_fullsized":"2024-04-26T02:24:48.674610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.325226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011084093999999999,"stat_sum":{"num_bytes":16891904,"num_objects":13,"num_object_clones":5,"num_object_copies":91,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":2,"num_read":50,"num_read_kb":39238,"num_write":60,"num_write_kb":16496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"17","length":"1"},{"start":"1b","length":"1"}]},{"pgid":"3.b","version":"77'31","reported_seq":261,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T02:24:45.480067+0000","last_change":"2024-04-26T02:24:42.468751+0000","last_active":"2024-04-26T02:24:45.480067+0000","last_peered":"2024-04-26T02:24:45.480067+0000","last_clean":"2024-04-26T02:24:45.480067+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:45.480067+0000","last_undegraded":"2024-04-26T02:24:45.480067+0000","last_fullsized":"2024-04-26T02:24:45.480067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.292745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092020899999999996,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":8,"num_read_kb":5,"num_write":38,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"3.a","version":"75'67","reported_seq":303,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-26T02:24:48.672420+0000","last_change":"2024-04-26T02:24:48.673182+0000","last_active":"2024-04-26T02:24:48.672420+0000","last_peered":"2024-04-26T02:24:48.672420+0000","last_clean":"2024-04-26T02:24:48.672420+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:48.672420+0000","last_undegraded":"2024-04-26T02:24:48.672420+0000","last_fullsized":"2024-04-26T02:24:48.672420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:23.751469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010927409999999999,"stat_sum":{"num_bytes":4292608,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":45,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"17","length":"1"},{"start":"1b","length":"1"}]},{"pgid":"3.9","version":"76'46","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.508363+0000","last_change":"2024-04-26T02:24:42.470844+0000","last_active":"2024-04-26T02:24:46.508363+0000","last_peered":"2024-04-26T02:24:46.508363+0000","last_clean":"2024-04-26T02:24:46.508363+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:46.508363+0000","last_undegraded":"2024-04-26T02:24:46.508363+0000","last_fullsized":"2024-04-26T02:24:46.508363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.748414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001592481,"stat_sum":{"num_bytes":3670016,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":247,"num_write":59,"num_write_kb":4848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"3.8","version":"78'60","reported_seq":292,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.515160+0000","last_change":"2024-04-26T02:24:42.494511+0000","last_active":"2024-04-26T02:24:46.515160+0000","last_peered":"2024-04-26T02:24:46.515160+0000","last_clean":"2024-04-26T02:24:46.515160+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:46.515160+0000","last_undegraded":"2024-04-26T02:24:46.515160+0000","last_fullsized":"2024-04-26T02:24:46.515160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:01.801734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015110402,"stat_sum":{"num_bytes":5537792,"num_objects":7,"num_object_clones":3,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":22,"num_read_kb":3129,"num_write":44,"num_write_kb":4160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"1.0","version":"26'157","reported_seq":313,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.515756+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:46.515756+0000","last_peered":"2024-04-26T02:24:46.515756+0000","last_clean":"2024-04-26T02:24:46.515756+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:46.515756+0000","last_undegraded":"2024-04-26T02:24:46.515756+0000","last_fullsized":"2024-04-26T02:24:46.515756+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.515646+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:46.515646+0000","last_peered":"2024-04-26T02:24:46.515646+0000","last_clean":"2024-04-26T02:24:46.515646+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:46.515646+0000","last_undegraded":"2024-04-26T02:24:46.515646+0000","last_fullsized":"2024-04-26T02:24:46.515646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"75'50","reported_seq":280,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.515490+0000","last_change":"2024-04-26T02:24:42.493703+0000","last_active":"2024-04-26T02:24:46.515490+0000","last_peered":"2024-04-26T02:24:46.515490+0000","last_clean":"2024-04-26T02:24:46.515490+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:46.515490+0000","last_undegraded":"2024-04-26T02:24:46.515490+0000","last_fullsized":"2024-04-26T02:24:46.515490+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:17.369760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.023079157999999999,"stat_sum":{"num_bytes":4046848,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":5984,"num_write":22,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"2.0","version":"0'0","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T02:24:47.781563+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:47.781563+0000","last_peered":"2024-04-26T02:24:47.781563+0000","last_clean":"2024-04-26T02:24:47.781563+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:47.781563+0000","last_undegraded":"2024-04-26T02:24:47.781563+0000","last_fullsized":"2024-04-26T02:24:47.781563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"75'51","reported_seq":283,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T02:24:45.878859+0000","last_change":"2024-04-26T02:24:42.487234+0000","last_active":"2024-04-26T02:24:45.878859+0000","last_peered":"2024-04-26T02:24:45.878859+0000","last_clean":"2024-04-26T02:24:45.878859+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:45.878859+0000","last_undegraded":"2024-04-26T02:24:45.878859+0000","last_fullsized":"2024-04-26T02:24:45.878859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.717534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007934778,"stat_sum":{"num_bytes":11026432,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":13209,"num_write":25,"num_write_kb":11456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"2.1","version":"0'0","reported_seq":113,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.515435+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:46.515435+0000","last_peered":"2024-04-26T02:24:46.515435+0000","last_clean":"2024-04-26T02:24:46.515435+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:46.515435+0000","last_undegraded":"2024-04-26T02:24:46.515435+0000","last_fullsized":"2024-04-26T02:24:46.515435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"66'35","reported_seq":266,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T02:24:45.492059+0000","last_change":"2024-04-26T02:24:42.489208+0000","last_active":"2024-04-26T02:24:45.492059+0000","last_peered":"2024-04-26T02:24:45.492059+0000","last_clean":"2024-04-26T02:24:45.492059+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:45.492059+0000","last_undegraded":"2024-04-26T02:24:45.492059+0000","last_fullsized":"2024-04-26T02:24:45.492059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.598817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001615544,"stat_sum":{"num_bytes":6848512,"num_objects":3,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":2360,"num_write":22,"num_write_kb":6688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"2.2","version":"0'0","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T02:24:47.781929+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:47.781929+0000","last_peered":"2024-04-26T02:24:47.781929+0000","last_clean":"2024-04-26T02:24:47.781929+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:47.781929+0000","last_undegraded":"2024-04-26T02:24:47.781929+0000","last_fullsized":"2024-04-26T02:24:47.781929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":224,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T02:24:45.489436+0000","last_change":"2024-04-26T02:24:42.482015+0000","last_active":"2024-04-26T02:24:45.489436+0000","last_peered":"2024-04-26T02:24:45.489436+0000","last_clean":"2024-04-26T02:24:45.489436+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:45.489436+0000","last_undegraded":"2024-04-26T02:24:45.489436+0000","last_fullsized":"2024-04-26T02:24:45.489436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:27.294462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090676099999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"3.5","version":"77'55","reported_seq":299,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T02:24:47.782438+0000","last_change":"2024-04-26T02:24:42.478272+0000","last_active":"2024-04-26T02:24:47.782438+0000","last_peered":"2024-04-26T02:24:47.782438+0000","last_clean":"2024-04-26T02:24:47.782438+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:47.782438+0000","last_undegraded":"2024-04-26T02:24:47.782438+0000","last_fullsized":"2024-04-26T02:24:47.782438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:23.716478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090485800000000003,"stat_sum":{"num_bytes":3473408,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":29,"num_read_kb":4831,"num_write":67,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"1"},{"start":"17","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T02:24:45.878685+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:45.878685+0000","last_peered":"2024-04-26T02:24:45.878685+0000","last_clean":"2024-04-26T02:24:45.878685+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:45.878685+0000","last_undegraded":"2024-04-26T02:24:45.878685+0000","last_fullsized":"2024-04-26T02:24:45.878685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":226,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-04-26T02:24:45.480071+0000","last_change":"2024-04-26T02:24:42.469256+0000","last_active":"2024-04-26T02:24:45.480071+0000","last_peered":"2024-04-26T02:24:45.480071+0000","last_clean":"2024-04-26T02:24:45.480071+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:45.480071+0000","last_undegraded":"2024-04-26T02:24:45.480071+0000","last_fullsized":"2024-04-26T02:24:45.480071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:07.661014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092564299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"2.5","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.479954+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:46.479954+0000","last_peered":"2024-04-26T02:24:46.479954+0000","last_clean":"2024-04-26T02:24:46.479954+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:46.479954+0000","last_undegraded":"2024-04-26T02:24:46.479954+0000","last_fullsized":"2024-04-26T02:24:46.479954+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'32","reported_seq":277,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-04-26T02:24:49.572116+0000","last_change":"2024-04-26T02:24:49.573996+0000","last_active":"2024-04-26T02:24:49.572116+0000","last_peered":"2024-04-26T02:24:49.572116+0000","last_clean":"2024-04-26T02:24:49.572116+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:49.572116+0000","last_undegraded":"2024-04-26T02:24:49.572116+0000","last_fullsized":"2024-04-26T02:24:49.572116+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:23.477843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.015345614,"stat_sum":{"num_bytes":770048,"num_objects":3,"num_object_clones":1,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":1,"num_read":5,"num_read_kb":2,"num_write":9,"num_write_kb":752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"1"},{"start":"1b","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":112,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.516415+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:46.516415+0000","last_peered":"2024-04-26T02:24:46.516415+0000","last_clean":"2024-04-26T02:24:46.516415+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:46.516415+0000","last_undegraded":"2024-04-26T02:24:46.516415+0000","last_fullsized":"2024-04-26T02:24:46.516415+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"66'60","reported_seq":293,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-26T02:24:46.516699+0000","last_change":"2024-04-26T02:24:42.477203+0000","last_active":"2024-04-26T02:24:46.516699+0000","last_peered":"2024-04-26T02:24:46.516699+0000","last_clean":"2024-04-26T02:24:46.516699+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:46.516699+0000","last_undegraded":"2024-04-26T02:24:46.516699+0000","last_fullsized":"2024-04-26T02:24:46.516699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:28.795709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000622424,"stat_sum":{"num_bytes":6733824,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":7113,"num_write":51,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"12","length":"1"},{"start":"14","length":"4"}]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-26T02:24:47.781751+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:47.781751+0000","last_peered":"2024-04-26T02:24:47.781751+0000","last_clean":"2024-04-26T02:24:47.781751+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:47.781751+0000","last_undegraded":"2024-04-26T02:24:47.781751+0000","last_fullsized":"2024-04-26T02:24:47.781751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":96747520,"num_objects":72,"num_object_clones":26,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":6,"num_read":282,"num_read_kb":90885,"num_write":581,"num_write_kb":104160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":164769792,"data_stored":211496960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":813,"ondisk_log_size":813,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215122,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43680,"kb_used_data":12496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328160,"statfs":{"total":96636764160,"available":96592035840,"internally_reserved":0,"allocated":12795904,"data_stored":16310853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215119,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38940,"kb_used_data":7756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332900,"statfs":{"total":96636764160,"available":96596889600,"internally_reserved":0,"allocated":7942144,"data_stored":9994821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215119,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46276,"kb_used_data":15088,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325564,"statfs":{"total":96636764160,"available":96589377536,"internally_reserved":0,"allocated":15450112,"data_stored":19462880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313231,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42216,"kb_used_data":15196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329624,"statfs":{"total":96636764160,"available":96593534976,"internally_reserved":0,"allocated":15560704,"data_stored":21054265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280526,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39916,"kb_used_data":8728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331924,"statfs":{"total":96636764160,"available":96595890176,"internally_reserved":0,"allocated":8937472,"data_stored":10471832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280527,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":5708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":5844992,"data_stored":6597016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280528,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42640,"kb_used_data":15612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329200,"statfs":{"total":96636764160,"available":96593100800,"internally_reserved":0,"allocated":15986688,"data_stored":19096027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280526,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39184,"kb_used_data":12164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332656,"statfs":{"total":96636764160,"available":96596639744,"internally_reserved":0,"allocated":12455936,"data_stored":14473708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280528,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34672,"kb_used_data":7644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337168,"statfs":{"total":96636764160,"available":96601260032,"internally_reserved":0,"allocated":7827456,"data_stored":7950811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280526,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39300,"kb_used_data":12272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":12566528,"data_stored":14606811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280526,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37176,"kb_used_data":5996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334664,"statfs":{"total":96636764160,"available":96598695936,"internally_reserved":0,"allocated":6139904,"data_stored":6630412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280527,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35276,"kb_used_data":8248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94336564,"statfs":{"total":96636764160,"available":96600641536,"internally_reserved":0,"allocated":8445952,"data_stored":9122811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280526,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43036,"kb_used_data":11848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94328804,"statfs":{"total":96636764160,"available":96592695296,"internally_reserved":0,"allocated":12132352,"data_stored":15536603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280527,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42304,"kb_used_data":15276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329536,"statfs":{"total":96636764160,"available":96593444864,"internally_reserved":0,"allocated":15642624,"data_stored":19751387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280527,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34632,"kb_used_data":7604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337208,"statfs":{"total":96636764160,"available":96601300992,"internally_reserved":0,"allocated":7786496,"data_stored":7885275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215119,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46968,"kb_used_data":15784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94324872,"statfs":{"total":96636764160,"available":96588668928,"internally_reserved":0,"allocated":16162816,"data_stored":21013061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15020032,"data_stored":20361216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14876672,"data_stored":18464768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6717440,"data_stored":7319552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14385152,"data_stored":20381696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14290944,"data_stored":18800640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4481024,"data_stored":5459968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7335936,"data_stored":8630272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11022336,"data_stored":14905344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":6799360,"data_stored":9342976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":15065088,"data_stored":19787776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":7843840,"data_stored":10010624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":5976064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":11653120,"data_stored":15659008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":7208960,"data_stored":7921664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":11329536,"data_stored":13832192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":11988992,"data_stored":14643200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:51.370 INFO:tasks.ceph.ceph_manager.ceph:would drop below min_pgs, proj 6, currently 16 2024-04-26T02:24:51.370 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:51.371 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:51.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:51.412 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:51.411+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:51.498 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:51.498 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:51.504 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:51.501+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:51.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:24:51.574 INFO:tasks.rados.rados.0.smithi175.stdout:279: done (6 left) 2024-04-26T02:24:51.574 INFO:tasks.rados.rados.0.smithi175.stdout:280: read oid 42 snap -1 2024-04-26T02:24:51.575 INFO:tasks.rados.rados.0.smithi175.stdout:280: expect (ObjNum 41 snap 0 seq_num 41) 2024-04-26T02:24:51.575 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 43 current snap is 27 2024-04-26T02:24:51.575 INFO:tasks.rados.rados.0.smithi175.stdout:281: seq_num 132 ranges {720896=671744,1392640=573440,1966080=753664,2719744=229376} 2024-04-26T02:24:51.576 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:24:51.586 INFO:tasks.rados.rados.0.smithi175.stdout:281: writing smithi17529564-43 from 720896 to 1392640 tid 1 2024-04-26T02:24:51.593 INFO:tasks.rados.rados.0.smithi175.stdout:281: writing smithi17529564-43 from 1392640 to 1966080 tid 2 2024-04-26T02:24:51.600 INFO:tasks.rados.rados.0.smithi175.stdout:281: writing smithi17529564-43 from 1966080 to 2719744 tid 3 2024-04-26T02:24:51.602 INFO:tasks.rados.rados.0.smithi175.stdout:281: writing smithi17529564-43 from 2719744 to 2949120 tid 4 2024-04-26T02:24:51.602 INFO:tasks.rados.rados.0.smithi175.stdout:282: snap_remove snap 15 2024-04-26T02:24:51.606 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:51.599+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:51.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:51.685 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:51.685 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:51.701 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:24:51.706 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:51.699+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:51.806 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:51.806 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:51.807 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:51.803+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:51.827 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:51.827 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:51.848 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:51.869 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:51.870 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:51.870 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:51.884 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:24:51.887 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:51.888 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:51.907 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:51.903+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:51.910 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:51.932 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:51.951 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:51.951 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:51.973 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:51.973 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:51.995 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:51.995 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:52.005 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:52.005 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:52.008 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:52.003+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:52.018 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:52.018 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:52.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:24:52.039 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:52.040 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:52.060 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:52.061 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:52.083 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:52.084 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:52.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:52.099+0000 7f483dd4c640 0 -- 172.21.15.59:0/992782174 >> [v2:172.21.15.142:6809/4003882581,v1:172.21.15.142:6811/4003882581] conn(0x7f4838220a10 msgr2=0x7f4838222e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:52.104 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:52.105 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:52.109 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:52.105+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:52.125 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:52.125 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:52.147 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.147 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.108244581000001, 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0094430320000000005, 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.148 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035733+0000", 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035735+0000", 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8330000000000001e-06 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035787+0000", 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2111000000000003e-05 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.149 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035818+0000", 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0599000000000003e-05 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035841+0000", 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2889000000000001e-05 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036181+0000", 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340057 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.150 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.036195+0000", 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4769e-05 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045085+0000", 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088895439999999992 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.151 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045176+0000", 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1230000000000006e-05 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 37/31 ECSubWrite(tid=178, reqid=osd.6.0:178, at_version=37'15, trim_to=0'0, roll_forward_to=36'13))", 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.105815663999998, 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095415010000000008, 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.152 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038162+0000", 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038163+0000", 2024-04-26T02:24:52.153 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7999999999999995e-07 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038217+0000", 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4588e-05 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038250+0000", 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2628e-05 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038274+0000", 2024-04-26T02:24:52.154 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4256e-05 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038532+0000", 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025780300000000003 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.038556+0000", 2024-04-26T02:24:52.155 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3811999999999998e-05 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047633+0000", 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090777800000000006 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.047704+0000", 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0054000000000004e-05 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.156 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.103427246999999, 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089888439999999993, 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.157 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040550+0000", 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040551+0000", 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6199999999999999e-07 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.158 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040593+0000", 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2224000000000001e-05 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040614+0000", 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0746000000000001e-05 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040630+0000", 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6441999999999999e-05 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.159 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041176+0000", 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00054610900000000003 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041224+0000", 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7712e-05 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.160 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049439+0000", 2024-04-26T02:24:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082147729999999999 2024-04-26T02:24:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049539+0000", 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100476 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 37/31 ECSubWrite(tid=31, reqid=osd.13.0:31, at_version=37'10, trim_to=0'0, roll_forward_to=36'8))", 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.103313616999998, 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087839709999999998, 2024-04-26T02:24:52.163 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.164 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040664+0000", 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040665+0000", 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3399999999999998e-07 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040718+0000", 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2923999999999997e-05 2024-04-26T02:24:52.165 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040748+0000", 2024-04-26T02:24:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0709e-05 2024-04-26T02:24:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.166 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040771+0000", 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2636000000000001e-05 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041006+0000", 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023521999999999999 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.041030+0000", 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3736000000000001e-05 2024-04-26T02:24:52.167 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049357+0000", 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083271030000000006 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.049448+0000", 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0909000000000007e-05 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.168 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.103310346999997, 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012142201, 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.169 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040667+0000", 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040668+0000", 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2699999999999998e-07 2024-04-26T02:24:52.170 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040700+0000", 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1668999999999998e-05 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040714+0000", 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4517e-05 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.171 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.040730+0000", 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6030000000000001e-05 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046667+0000", 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0059366619999999997 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.172 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046693+0000", 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5769e-05 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052718+0000", 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0060254139999999998 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.173 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.052810+0000", 2024-04-26T02:24:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1312999999999998e-05 2024-04-26T02:24:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.174 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:261 3.6s0 3:67e91997:::smithi17529564-21:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.016671445999997, 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097788909999999996, 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 261 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.175 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127306+0000", 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127307+0000", 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2399999999999998e-07 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.176 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127310+0000", 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.021e-06 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127316+0000", 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9309999999999996e-06 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127321+0000", 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2020000000000003e-06 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.177 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129502+0000", 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002180586 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129561+0000", 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9558000000000001e-05 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129830+0000", 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268829 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.178 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.131759+0000", 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019285280000000001 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.136744+0000", 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049853220000000004 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.137085+0000", 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034129000000000001 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:262 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 42.016637582999998, 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013830606, 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 262 2024-04-26T02:24:52.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127341+0000", 2024-04-26T02:24:52.181 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5300000000000004e-07 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127343+0000", 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4399999999999999e-06 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127349+0000", 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2369999999999997e-06 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.182 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127356+0000", 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1600000000000001e-06 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129990+0000", 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026331509999999998 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.130041+0000", 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1842999999999998e-05 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.183 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138025+0000", 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079837410000000008 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138259+0000", 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023420799999999999 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.141171+0000", 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029112729999999998 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:274 3.6s0 3:687a1e37:::smithi17529564-28:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.988732376999998, 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0090195850000000001, 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 274 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155245+0000", 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155247+0000", 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4300000000000001e-06 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155253+0000", 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0560000000000001e-06 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155265+0000", 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2407e-05 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155275+0000", 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0149000000000001e-05 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160233+0000", 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049580379999999997 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160381+0000", 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000147207 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.160878+0000", 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049781399999999996 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.163164+0000", 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002285881 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164154+0000", 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00098951799999999999 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164265+0000", 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000111085 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.189 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:275 3.6s0 3:687a1e37:::smithi17529564-28:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.988662425999998, 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011804706999999999, 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.190 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 275 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155315+0000", 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155316+0000", 2024-04-26T02:24:52.191 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2299999999999999e-07 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155320+0000", 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.49e-06 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155331+0000", 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.136e-05 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.155343+0000", 2024-04-26T02:24:52.192 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2369e-05 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162104+0000", 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067605010000000004 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.162345+0000", 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000240669 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.193 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.164877+0000", 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002532075 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165083+0000", 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020615600000000001 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.167120+0000", 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0020371640000000002 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.194 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 55/31 ECSubWrite(tid=116, reqid=client.4589.0:370, at_version=55'47, trim_to=0'0, roll_forward_to=51'45))", 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 29.658135363, 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0093206069999999999, 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:52.195 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485842+0000", 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.485843+0000", 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2600000000000002e-07 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486710+0000", 2024-04-26T02:24:52.196 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000867617 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486747+0000", 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6479000000000001e-05 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486769+0000", 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2495999999999999e-05 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486936+0000", 2024-04-26T02:24:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016618899999999999 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.486963+0000", 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6936000000000001e-05 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.495030+0000", 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0080676740000000004 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.495163+0000", 2024-04-26T02:24:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013269000000000001 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.572048659, 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01458187, 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571930+0000", 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.08e-06 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.200 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571981+0000", 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0992000000000002e-05 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572011+0000", 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0266000000000001e-05 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572031+0000", 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9380000000000001e-05 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.201 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573094+0000", 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010632339999999999 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573112+0000", 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8323000000000001e-05 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586418+0000", 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013305783999999999 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.202 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586511+0000", 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2811000000000003e-05 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.569577325000001, 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012103983, 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.203 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574400+0000", 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574401+0000", 2024-04-26T02:24:52.204 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574452+0000", 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0785999999999998e-05 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574483+0000", 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1012000000000001e-05 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574507+0000", 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3666999999999999e-05 2024-04-26T02:24:52.205 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574610+0000", 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010356 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574620+0000", 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0212e-05 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586431+0000", 2024-04-26T02:24:52.206 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011810467999999999 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586504+0000", 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3558000000000003e-05 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.0s6 59/31 ECSubWrite(tid=37, reqid=osd.1.0:37, at_version=59'25, trim_to=0'0, roll_forward_to=51'23))", 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.569382566000002, 2024-04-26T02:24:52.207 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01197989, 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574595+0000", 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.208 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574596+0000", 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.034e-06 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574638+0000", 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1389e-05 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574659+0000", 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1732000000000001e-05 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.209 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574671+0000", 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1737e-05 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574820+0000", 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014874899999999999 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.574845+0000", 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.497e-05 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.210 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586519+0000", 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0116744 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586575+0000", 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5878999999999998e-05 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 59/31 ECSubWrite(tid=79, reqid=osd.13.0:77, at_version=0'0, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:24:52.211 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.567892045000001, 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015265225, 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:24:52.212 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576087+0000", 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.33e-07 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576116+0000", 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9782999999999999e-05 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576138+0000", 2024-04-26T02:24:52.213 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1696e-05 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576172+0000", 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3872999999999999e-05 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578894+0000", 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002721986 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578918+0000", 2024-04-26T02:24:52.214 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4042000000000001e-05 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591165+0000", 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012247417 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591351+0000", 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018549500000000001 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.215 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.567529827000001, 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015022990999999999, 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.216 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576450+0000", 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.72e-06 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.217 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576517+0000", 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7062000000000003e-05 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576552+0000", 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5466000000000002e-05 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576573+0000", 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0835999999999998e-05 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.218 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576692+0000", 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119474 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576717+0000", 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5032e-05 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591376+0000", 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014658857000000001 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.219 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591471+0000", 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4543999999999995e-05 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.bs1 59/31 ECSubWrite(tid=32, reqid=osd.7.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=59'21))", 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.563820840999998, 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011853449, 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.220 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580157+0000", 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580158+0000", 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5570000000000001e-06 2024-04-26T02:24:52.221 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580183+0000", 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4272000000000001e-05 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580213+0000", 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0003000000000001e-05 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580249+0000", 2024-04-26T02:24:52.222 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5942999999999998e-05 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580419+0000", 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017053200000000001 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580445+0000", 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5452999999999998e-05 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591931+0000", 2024-04-26T02:24:52.223 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011486194 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592010+0000", 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9494999999999997e-05 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.0s6 82/31 ECSubWrite(tid=60, reqid=osd.1.0:59, at_version=0'0, trim_to=0'0, roll_forward_to=82'45))", 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:49.559975+0000", 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 2.584003123, 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088063429999999995, 2024-04-26T02:24:52.224 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.559975+0000", 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.559975+0000", 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.225 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.559976+0000", 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.203e-06 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.559999+0000", 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2838999999999999e-05 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.560025+0000", 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6838999999999998e-05 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.226 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.560046+0000", 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0288999999999998e-05 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562199+0000", 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002153687 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.227 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562225+0000", 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5352000000000001e-05 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.568722+0000", 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064977059999999998 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.568781+0000", 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8427999999999997e-05 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.228 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 82/31 ECSubWrite(tid=233, reqid=osd.6.0:233, at_version=82'62, trim_to=0'0, roll_forward_to=78'60))", 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:49.562173+0000", 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 2.5818045509999998, 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012022648, 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562173+0000", 2024-04-26T02:24:52.229 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562173+0000", 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.230 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562174+0000", 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8599999999999998e-07 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562285+0000", 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110979 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562312+0000", 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7691e-05 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.231 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562335+0000", 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2463000000000002e-05 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562489+0000", 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154699 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.562508+0000", 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8255000000000001e-05 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.232 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.574144+0000", 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011636112000000001 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.574196+0000", 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1962999999999997e-05 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s2 82/31 ECSubWrite(tid=79, reqid=osd.8.0:79, at_version=82'57, trim_to=0'0, roll_forward_to=77'55))", 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:49.564228+0000", 2024-04-26T02:24:52.233 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 2.579749976, 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099723569999999994, 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564228+0000", 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564228+0000", 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.234 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564229+0000", 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2299999999999999e-07 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564300+0000", 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1800999999999999e-05 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564327+0000", 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6767999999999999e-05 2024-04-26T02:24:52.235 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564349+0000", 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1878999999999998e-05 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564514+0000", 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000164819 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.564568+0000", 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4601000000000001e-05 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.236 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.574105+0000", 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095361509999999997 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.574200+0000", 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5414999999999994e-05 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 82/31 ECSubWrite(tid=133, reqid=osd.13.0:133, at_version=82'61, trim_to=0'0, roll_forward_to=81'57))", 2024-04-26T02:24:52.237 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:49.565522+0000", 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 2.5784560550000002, 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089304209999999992, 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565522+0000", 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565522+0000", 2024-04-26T02:24:52.238 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565524+0000", 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9570000000000001e-06 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565577+0000", 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2927999999999999e-05 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565610+0000", 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3077999999999997e-05 2024-04-26T02:24:52.239 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565631+0000", 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1522000000000002e-05 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565796+0000", 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016526900000000001 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.565824+0000", 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7898999999999998e-05 2024-04-26T02:24:52.240 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.574338+0000", 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085137029999999992 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:49.574452+0000", 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000114065 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:52.241 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:52.243 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:52.237+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:52.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:24:52.344 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:52.343+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:52.374 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:52.374 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:52.374 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:52.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:24:52.445 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:52.439+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:52.475 INFO:tasks.rados.rados.0.smithi175.stdout:282: done (8 left) 2024-04-26T02:24:52.475 INFO:tasks.rados.rados.0.smithi175.stdout:283: read oid 21 snap -1 2024-04-26T02:24:52.475 INFO:tasks.rados.rados.0.smithi175.stdout:283: expect (ObjNum 72 snap 4 seq_num 72) 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:284: rmattr oid 4 current snap is 27 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:285: snap_create 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: finishing write tid 3 to smithi17529564-8 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: finishing write tid 4 to smithi17529564-8 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: finishing write tid 5 to smithi17529564-8 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:275: finishing rollback tid 0 to smithi17529564-6 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:275: finishing rollback tid 1 to smithi17529564-6 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:273: finishing copy_from racing read to smithi17529564-34 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:275: finishing rollback tid 2 to smithi17529564-6 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 6 v 66 (ObjNum 102 snap 13 seq_num 102) dirty exists 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:272: finishing copy_from racing read to smithi17529564-45 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: finishing write tid 6 to smithi17529564-8 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: oid 8 updating version 0 to 66 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: oid 8 updating version 66 to 67 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: oid 8 updating version 67 to 68 2024-04-26T02:24:52.476 INFO:tasks.rados.rados.0.smithi175.stdout:271: oid 8 version 68 is already newer than 65 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:271: oid 8 version 68 is already newer than 64 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 8 v 68 (ObjNum 130 snap 27 seq_num 130) dirty exists 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:271: left oid 8 (ObjNum 130 snap 27 seq_num 130) 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:272: finishing copy_from to smithi17529564-45 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 45 v 4 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:273: finishing copy_from to smithi17529564-34 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 34 v 50 (ObjNum 86 snap 12 seq_num 86) dirty exists 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: finishing write tid 1 to smithi17529564-49 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: finishing write tid 2 to smithi17529564-49 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: finishing write tid 3 to smithi17529564-49 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: finishing write tid 4 to smithi17529564-49 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: finishing write tid 5 to smithi17529564-49 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: finishing write tid 6 to smithi17529564-49 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: oid 49 updating version 0 to 74 2024-04-26T02:24:52.477 INFO:tasks.rados.rados.0.smithi175.stdout:277: oid 49 version 74 is already newer than 73 2024-04-26T02:24:52.478 INFO:tasks.rados.rados.0.smithi175.stdout:277: oid 49 version 74 is already newer than 70 2024-04-26T02:24:52.478 INFO:tasks.rados.rados.0.smithi175.stdout:277: oid 49 version 74 is already newer than 72 2024-04-26T02:24:52.478 INFO:tasks.rados.rados.0.smithi175.stdout:277: oid 49 version 74 is already newer than 71 2024-04-26T02:24:52.478 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 49 v 74 (ObjNum 131 snap 27 seq_num 131) dirty exists 2024-04-26T02:24:52.478 INFO:tasks.rados.rados.0.smithi175.stdout:277: left oid 49 (ObjNum 131 snap 27 seq_num 131) 2024-04-26T02:24:52.478 INFO:tasks.rados.rados.0.smithi175.stdout:280: expect (ObjNum 41 snap 0 seq_num 41) 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: finishing write tid 1 to smithi17529564-43 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: finishing write tid 2 to smithi17529564-43 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: finishing write tid 3 to smithi17529564-43 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: finishing write tid 4 to smithi17529564-43 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: finishing write tid 5 to smithi17529564-43 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: finishing write tid 6 to smithi17529564-43 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: oid 43 updating version 0 to 35 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: oid 43 updating version 35 to 38 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: oid 43 version 38 is already newer than 37 2024-04-26T02:24:52.537 INFO:tasks.rados.rados.0.smithi175.stdout:281: oid 43 version 38 is already newer than 36 2024-04-26T02:24:52.538 INFO:tasks.rados.rados.0.smithi175.stdout:281: oid 43 version 38 is already newer than 34 2024-04-26T02:24:52.538 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 43 v 38 (ObjNum 132 snap 27 seq_num 132) dirty exists 2024-04-26T02:24:52.538 INFO:tasks.rados.rados.0.smithi175.stdout:281: left oid 43 (ObjNum 132 snap 27 seq_num 132) 2024-04-26T02:24:52.538 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 73 (ObjNum 129 snap 0 seq_num 3112326160) dirty exists 2024-04-26T02:24:52.538 INFO:tasks.rados.rados.0.smithi175.stdout:283: expect (ObjNum 72 snap 4 seq_num 72) 2024-04-26T02:24:52.546 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:52.543+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:52.576 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:52.577 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:52.577 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:52.577 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:52.577 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:52.591 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:24:52.648 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:52.645+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:52.749 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:52.745+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:252 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.684947979, 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018057229000000001, 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.761 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 252 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.762 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071932+0000", 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6830000000000001e-06 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071949+0000", 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.747e-05 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.763 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071991+0000", 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1634999999999997e-05 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072017+0000", 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5732999999999999e-05 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072400+0000", 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038336099999999998 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.764 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072421+0000", 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1086000000000001e-05 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083152+0000", 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010731001 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.765 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083378+0000", 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022567 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089985+0000", 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00660759 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.766 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:253 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.684791994000001, 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018975438000000001, 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 253 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.767 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072086+0000", 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5629999999999999e-06 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.768 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.769 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072096+0000", 2024-04-26T02:24:52.770 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0586e-05 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072127+0000", 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.771 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072144+0000", 2024-04-26T02:24:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7694e-05 2024-04-26T02:24:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.772 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072656+0000", 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000511967 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072677+0000", 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0908999999999999e-05 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.084846+0000", 2024-04-26T02:24:52.773 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012169164 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.085079+0000", 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000232613 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.091060+0000", 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059807230000000003 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.774 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:254 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.684697213, 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.02061644, 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 254 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.775 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072180+0000", 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.393e-06 2024-04-26T02:24:52.776 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072190+0000", 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6320000000000003e-06 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072216+0000", 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5667e-05 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072250+0000", 2024-04-26T02:24:52.777 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4261999999999998e-05 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072786+0000", 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053627299999999998 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072805+0000", 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8787000000000002e-05 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.778 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.086864+0000", 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014058795000000001 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.087018+0000", 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000154492 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092795+0000", 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057771389999999997 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.779 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:287 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~671744] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.570424654999997, 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20982231300000001, 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 287 2024-04-26T02:24:52.780 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.781 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186454+0000", 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.599e-06 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188135+0000", 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001681297 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188161+0000", 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5639999999999998e-05 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.782 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188176+0000", 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4696e-05 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188349+0000", 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000173361 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188599+0000", 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025008099999999998 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.783 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190936+0000", 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023371910000000002 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.194810+0000", 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038734189999999999 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396085+0000", 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20127497799999999 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.784 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396274+0000", 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000189051 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:288 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~98304] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.568589920000001, 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.208333828, 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.785 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 288 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:24:52.786 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188288+0000", 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8679999999999999e-06 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188377+0000", 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9355000000000001e-05 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188412+0000", 2024-04-26T02:24:52.787 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4533000000000003e-05 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188433+0000", 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0662e-05 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192429+0000", 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039958980000000003 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192696+0000", 2024-04-26T02:24:52.788 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026725799999999998 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.193713+0000", 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001017394 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196898+0000", 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031851710000000001 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.789 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396498+0000", 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.19959943599999999 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396620+0000", 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012225300000000001 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:289 3.fs0 3:f4c4efcf:::smithi17529564-16:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:52.790 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.568404825999998, 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.210050292, 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 289 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:52.791 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188473+0000", 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.792 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188482+0000", 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188514+0000", 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1452999999999999e-05 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188530+0000", 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6079999999999999e-05 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.793 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195465+0000", 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0069355390000000001 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195614+0000", 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149087 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196510+0000", 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089556900000000003 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.794 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197757+0000", 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012469650000000001 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398371+0000", 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20061418 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398522+0000", 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015068199999999999 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.795 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:290 3.fs0 3:f4c4efcf:::smithi17529564-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.568321109000003, 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.212763806, 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 290 2024-04-26T02:24:52.796 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188556+0000", 2024-04-26T02:24:52.797 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.437e-06 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188563+0000", 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9630000000000001e-06 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188584+0000", 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0262e-05 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.798 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188603+0000", 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9242999999999999e-05 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196982+0000", 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008379226 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197132+0000", 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149875 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.799 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399173+0000", 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.202040675 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399311+0000", 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000138243 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.401319+0000", 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020078819999999999 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.800 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:324 3.fs0 3:fc34d3d4:::smithi17529564-31:head [append 0~0] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.273752733000002, 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015454763999999999, 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 324 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.801 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483123+0000", 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483125+0000", 2024-04-26T02:24:52.802 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.849e-06 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483134+0000", 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7809999999999994e-06 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483153+0000", 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8841000000000001e-05 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483169+0000", 2024-04-26T02:24:52.803 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5739999999999998e-05 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483254+0000", 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5785999999999995e-05 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483262+0000", 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.418e-06 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.486485+0000", 2024-04-26T02:24:52.804 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032228140000000001 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.486647+0000", 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000162557 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.487943+0000", 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001295488 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.805 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.492691+0000", 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047483480000000003 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498449+0000", 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005757921 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498578+0000", 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000129221 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.806 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:325 3.fs0 3:fc34d3d4:::smithi17529564-31:head [rollback 6] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.273672513000001, 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01566555, 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 325 2024-04-26T02:24:52.807 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.808 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483204+0000", 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9999999999999997e-07 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483208+0000", 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9210000000000002e-06 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483218+0000", 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3370000000000006e-06 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.809 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483227+0000", 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2769999999999994e-06 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483367+0000", 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014014999999999999 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483382+0000", 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4545999999999999e-05 2024-04-26T02:24:52.810 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.488926+0000", 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.005544602 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.489142+0000", 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000215338 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.490131+0000", 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00098933399999999992 2024-04-26T02:24:52.811 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.496700+0000", 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065690790000000002 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498752+0000", 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020519259999999999 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.498869+0000", 2024-04-26T02:24:52.812 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011734 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:326 3.fs0 3:fc34d3d4:::smithi17529564-31:head [append 0~0] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 37.273634186000002, 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016185303000000002, 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.813 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 326 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483242+0000", 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.814 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483243+0000", 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-07 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483247+0000", 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0450000000000002e-06 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483259+0000", 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2077e-05 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.815 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483268+0000", 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8100000000000004e-06 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483438+0000", 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000170815 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.483448+0000", 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7389999999999994e-06 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.816 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.491090+0000", 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076419920000000002 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.491253+0000", 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016303800000000001 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.817 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.492098+0000", 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00084462600000000001 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.496789+0000", 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046916220000000003 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.499227+0000", 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0024372529999999999 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.818 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:15.499427+0000", 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000200638 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:332 3.cs0 3:3fb4b57b:::smithi17529564-46:head [append 0~0] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.273066102999998, 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014564338, 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.819 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 332 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.820 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483810+0000", 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483812+0000", 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4559999999999999e-06 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483819+0000", 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2200000000000003e-06 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.821 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483840+0000", 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1665999999999999e-05 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483856+0000", 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5270000000000001e-05 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484001+0000", 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014564600000000001 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.822 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484024+0000", 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2875999999999999e-05 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488065+0000", 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0040404899999999999 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.488246+0000", 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000181788 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.823 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.489812+0000", 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001565823 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497402+0000", 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075900050000000004 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498113+0000", 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00071069199999999996 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.824 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498374+0000", 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000261406 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:333 3.cs0 3:3fb4b57b:::smithi17529564-46:head [rollback 6] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.272989162000002, 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015996089000000002, 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.825 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 333 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.826 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483887+0000", 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483888+0000", 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.367e-06 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483895+0000", 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0859999999999996e-06 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.827 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483918+0000", 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2926e-05 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483933+0000", 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5073e-05 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484094+0000", 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000161003 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:52.828 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484112+0000", 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7808999999999998e-05 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.491940+0000", 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078274620000000003 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.492202+0000", 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026212700000000002 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.829 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.493787+0000", 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001585562 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.497739+0000", 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003951319 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.499764+0000", 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020257140000000001 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.830 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.499883+0000", 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000118641 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:334 3.cs0 3:3fb4b57b:::smithi17529564-46:head [append 0~0] snapc a=[a,9,6] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 36.272895083999998, 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016347856000000001, 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.831 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 334 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.832 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483981+0000", 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483982+0000", 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2999999999999999e-07 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.483987+0000", 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7589999999999997e-06 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.833 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484006+0000", 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9117e-05 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484027+0000", 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0922000000000001e-05 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484169+0000", 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014197999999999999 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.834 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.484178+0000", 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3260000000000002e-06 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.494927+0000", 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010748627 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.495181+0000", 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025385000000000002 2024-04-26T02:24:52.835 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.496382+0000", 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001201793 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.498738+0000", 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002355359 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.500202+0000", 2024-04-26T02:24:52.836 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001464676 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:16.500329+0000", 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012651700000000001 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:370 3.cs0 3:384aaf8b:::smithi17529564-13:head [append 0~688128] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.479889+0000", 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.276986757, 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015547561999999999, 2024-04-26T02:24:52.837 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 370 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.479889+0000", 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.838 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.479889+0000", 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.479891+0000", 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9010000000000001e-06 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.480974+0000", 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001082614 2024-04-26T02:24:52.839 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.480989+0000", 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5247e-05 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.480998+0000", 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4610000000000008e-06 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.481051+0000", 2024-04-26T02:24:52.840 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3600000000000002e-05 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.481057+0000", 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.3929999999999999e-06 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.483952+0000", 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0028956089999999999 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.484017+0000", 2024-04-26T02:24:52.841 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5217999999999998e-05 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.485226+0000", 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012085900000000001 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.486395+0000", 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001168526 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495340+0000", 2024-04-26T02:24:52.842 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089451429999999992 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495437+0000", 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7260000000000001e-05 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:374 3.cs0 3:384aaf8b:::smithi17529564-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.261512648, 2024-04-26T02:24:52.843 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015685046000000001, 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 374 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.844 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495364+0000", 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1699999999999999e-07 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495365+0000", 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5409999999999999e-06 2024-04-26T02:24:52.845 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495371+0000", 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1440000000000002e-06 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495374+0000", 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.117e-06 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.846 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.498312+0000", 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002938726 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.498395+0000", 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2406999999999999e-05 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508720+0000", 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010324804 2024-04-26T02:24:52.847 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.508807+0000", 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7645000000000005e-05 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.511049+0000", 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022413450000000001 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.848 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:377 3.cs0 3:3fb4b57b:::smithi17529564-46:head [read 0~3096576,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.495484+0000", 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.261391787000001, 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014842746, 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 377 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.849 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495484+0000", 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495484+0000", 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495485+0000", 2024-04-26T02:24:52.850 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3300000000000001e-07 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495493+0000", 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9030000000000004e-06 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495497+0000", 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7400000000000004e-06 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.851 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.495500+0000", 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1530000000000001e-06 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.501071+0000", 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0055707830000000002 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.501129+0000", 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7989999999999999e-05 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.852 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.510327+0000", 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0091979439999999996 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:567 3.cs0 3:384aaf8b:::smithi17529564-13:head [read 0~1671168,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:37.573311+0000", 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.18356539, 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014786827000000001, 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.853 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 567 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.573311+0000", 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.573311+0000", 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.854 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.573311+0000", 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1800000000000005e-07 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.573318+0000", 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7569999999999998e-06 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.855 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.573334+0000", 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6138999999999999e-05 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.573343+0000", 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5709999999999998e-06 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577074+0000", 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0037313229999999999 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.856 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577169+0000", 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5070999999999998e-05 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.588098+0000", 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010928248 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:624 3.fs0 3:fb78ee5b:::smithi17529564-44:11 [read 0~1703936,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-04-26T02:24:52.857 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:41.496698+0000", 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.260177825, 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015739369, 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 624 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.858 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496698+0000", 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496698+0000", 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496701+0000", 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2460000000000002e-06 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.859 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496720+0000", 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9785000000000001e-05 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496735+0000", 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4555e-05 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496745+0000", 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0562e-05 2024-04-26T02:24:52.860 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.497863+0000", 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011173069999999999 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.497998+0000", 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000135153 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.512438+0000", 2024-04-26T02:24:52.861 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014439761000000001 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:625 3.fs0 3:fb78ee5b:::smithi17529564-44:11 [read 0~1703936,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:41.496766+0000", 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.260110217999999, 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.016873836999999999, 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.862 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 625 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496766+0000", 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496766+0000", 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.863 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496767+0000", 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7300000000000005e-07 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496773+0000", 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3090000000000001e-06 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496782+0000", 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3279999999999995e-06 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496789+0000", 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7349999999999999e-06 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.498512+0000", 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017233719999999999 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.498625+0000", 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000112419 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.513640+0000", 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015014901000000001 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:626 3.fs0 3:fb78ee5b:::smithi17529564-44:11 [read 0~1703936,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:41.496798+0000", 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.260077946999999, 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018212732999999998, 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:52.866 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 626 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496798+0000", 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:52.867 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496798+0000", 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496799+0000", 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4799999999999999e-07 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496802+0000", 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.782e-06 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:52.868 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496811+0000", 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5520000000000005e-06 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496817+0000", 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.501473+0000", 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046553860000000001 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.869 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.502604+0000", 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011312270000000001 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.515011+0000", 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012406992 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:52.870 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:52.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:24:52.873 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:52.867+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:52.972 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:52.971+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:53.003 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:53.003 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:53.003 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:53.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:24:53.074 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:53.073+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:53.141 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:53.141 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:53.142 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:53.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:24:53.175 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:53.175+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:53.276 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:53.275+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 55/31 ECSubWrite(tid=91, reqid=client.4589.0:378, at_version=0'0, trim_to=0'0, roll_forward_to=55'33))", 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:24:53.285 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.748544012, 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065763030000000004, 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.286 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535117+0000", 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.017e-06 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535132+0000", 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5427999999999999e-05 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.287 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535149+0000", 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6558e-05 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535156+0000", 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5930000000000002e-06 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535242+0000", 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6868999999999998e-05 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.288 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535251+0000", 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1200000000000002e-06 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.541609+0000", 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063584030000000003 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.541692+0000", 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3314999999999998e-05 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.289 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.bs5 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.723637155999999, 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080201519999999991, 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.290 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.03e-07 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.291 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560055+0000", 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2001000000000001e-05 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560107+0000", 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1989e-05 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560123+0000", 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5603e-05 2024-04-26T02:24:53.292 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560425+0000", 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030192899999999999 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560439+0000", 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4446e-05 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.567967+0000", 2024-04-26T02:24:53.293 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075278330000000003 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568043+0000", 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6048000000000001e-05 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 59/31 ECSubWrite(tid=77, reqid=osd.13.0:77, at_version=59'24, trim_to=0'0, roll_forward_to=58'22))", 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.722536746999999, 2024-04-26T02:24:53.294 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074306329999999999, 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.295 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561124+0000", 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.15e-07 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561159+0000", 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5326e-05 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561175+0000", 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6483000000000001e-05 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.296 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561190+0000", 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4626e-05 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561367+0000", 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000176696 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561394+0000", 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6991999999999998e-05 2024-04-26T02:24:53.297 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568489+0000", 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070955460000000003 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568554+0000", 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4648999999999997e-05 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.298 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.722433336999998, 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074280149999999996, 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.299 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4700000000000001e-07 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561250+0000", 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2586999999999999e-05 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.300 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561267+0000", 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7241e-05 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561278+0000", 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0586e-05 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561388+0000", 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000110166 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.301 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561400+0000", 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2553e-05 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568602+0000", 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072020119999999998 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568655+0000", 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2222999999999998e-05 2024-04-26T02:24:53.302 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.bs5 59/31 ECSubWrite(tid=32, reqid=osd.7.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=59'21))", 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.704001339000001, 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089319410000000005, 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.303 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.304 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579660+0000", 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2020000000000001e-06 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579676+0000", 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6146000000000001e-05 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579695+0000", 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8970999999999998e-05 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.305 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579707+0000", 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2024e-05 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579829+0000", 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000122459 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579843+0000", 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3869000000000001e-05 2024-04-26T02:24:53.306 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588534+0000", 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086902950000000007 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588591+0000", 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6975000000000003e-05 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.307 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.0s2 59/31 ECSubWrite(tid=38, reqid=osd.1.0:37, at_version=0'0, trim_to=0'0, roll_forward_to=59'25))", 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.695929918000001, 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076262750000000001, 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.308 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587731+0000", 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1620000000000001e-06 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587749+0000", 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.791e-05 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.309 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587768+0000", 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8657000000000001e-05 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587780+0000", 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2398000000000001e-05 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587901+0000", 2024-04-26T02:24:53.310 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000121264 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587916+0000", 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4396000000000001e-05 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595298+0000", 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073817470000000001 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.311 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595356+0000", 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8740999999999999e-05 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 59/31 ECSubWrite(tid=137, reqid=osd.12.0:134, at_version=0'0, trim_to=0'0, roll_forward_to=59'52))", 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.695070479999998, 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068257600000000002, 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.312 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.313 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588590+0000", 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2500000000000004e-07 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588606+0000", 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6001000000000001e-05 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588623+0000", 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6481999999999999e-05 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.314 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588635+0000", 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2481e-05 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588726+0000", 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0257e-05 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588738+0000", 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1917e-05 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.315 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595365+0000", 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006627473 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595415+0000", 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0223999999999999e-05 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.2s3 59/31 ECSubWrite(tid=20, reqid=osd.14.0:19, at_version=0'0, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:24:53.316 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.692349165, 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095002379999999994, 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.317 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591312+0000", 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.13e-06 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591326+0000", 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4403000000000001e-05 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.318 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591342+0000", 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5957999999999999e-05 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591354+0000", 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.184e-05 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591427+0000", 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2700000000000005e-05 2024-04-26T02:24:53.319 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591437+0000", 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.049e-05 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600754+0000", 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093168859999999999 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.320 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600811+0000", 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6830999999999998e-05 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 59/31 ECSubWrite(tid=47, reqid=osd.11.0:47, at_version=59'36, trim_to=0'0, roll_forward_to=58'32))", 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.692002544000001, 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0091052600000000004, 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.321 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.322 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591658+0000", 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7199999999999998e-07 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591690+0000", 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1347999999999999e-05 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.323 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591703+0000", 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3095000000000001e-05 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591709+0000", 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591781+0000", 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1532000000000006e-05 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.324 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591793+0000", 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1997000000000001e-05 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600686+0000", 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088932439999999998 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600763+0000", 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6503999999999998e-05 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.325 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 60/31 ECSubWrite(tid=138, reqid=client.4589.0:507, at_version=60'54, trim_to=0'0, roll_forward_to=59'52))", 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 25.808885706000002, 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067090819999999999, 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.326 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.327 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474775+0000", 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-04-26T02:24:53.328 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474962+0000", 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018722500000000001 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474997+0000", 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4761999999999997e-05 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475015+0000", 2024-04-26T02:24:53.329 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8153000000000001e-05 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475211+0000", 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000196627 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475224+0000", 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2748999999999999e-05 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.330 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481434+0000", 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062096260000000002 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481483+0000", 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9500999999999999e-05 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.0s2 66/31 ECSubWrite(tid=48, reqid=osd.1.0:48, at_version=66'35, trim_to=0'0, roll_forward_to=65'33))", 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.813672763, 2024-04-26T02:24:53.331 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070263529999999999, 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:24:53.332 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469988+0000", 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0200000000000002e-07 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470012+0000", 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4773000000000002e-05 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.333 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470027+0000", 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4894e-05 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470038+0000", 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0991e-05 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471109+0000", 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010704569999999999 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.334 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471119+0000", 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0332999999999999e-05 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476959+0000", 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058394240000000002 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477014+0000", 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4979000000000003e-05 2024-04-26T02:24:53.335 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.813586464, 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007325079, 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.336 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.337 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470115+0000", 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1431999999999999e-05 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470129+0000", 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3824e-05 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470138+0000", 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2439999999999999e-06 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.338 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471106+0000", 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00096715899999999999 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471117+0000", 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1871999999999999e-05 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477371+0000", 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062540130000000001 2024-04-26T02:24:53.339 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.340 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.340 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.340 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477399+0000", 2024-04-26T02:24:53.340 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.711e-05 2024-04-26T02:24:53.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.340 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.340 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.813267277000001, 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065435570000000002, 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.341 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470394+0000", 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.083e-06 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.342 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470435+0000", 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0899000000000003e-05 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470451+0000", 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6701000000000002e-05 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470465+0000", 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3946e-05 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.343 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471113+0000", 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00064768499999999995 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471119+0000", 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7379999999999999e-06 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476885+0000", 2024-04-26T02:24:53.344 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057667029999999998 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476936+0000", 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0801999999999999e-05 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 19.789823676000001, 2024-04-26T02:24:53.345 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076064669999999996, 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:24:53.346 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493837+0000", 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0049999999999999e-06 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493868+0000", 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0499999999999999e-05 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493883+0000", 2024-04-26T02:24:53.347 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5404e-05 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493894+0000", 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.094e-05 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.494065+0000", 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017112299999999999 2024-04-26T02:24:53.348 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.494077+0000", 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1402e-05 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.501400+0000", 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073234449999999996 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.349 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.501443+0000", 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2648000000000002e-05 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 71/31 ECSubWrite(tid=104, reqid=client.4589.0:593, at_version=71'34, trim_to=0'0, roll_forward_to=70'32))", 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.488278+0000", 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 14.795382160999999, 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081673049999999997, 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.350 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488278+0000", 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488278+0000", 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488279+0000", 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7000000000000003e-07 2024-04-26T02:24:53.351 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488329+0000", 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9910999999999997e-05 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488361+0000", 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1884000000000002e-05 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488384+0000", 2024-04-26T02:24:53.352 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3356000000000001e-05 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488920+0000", 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053646100000000001 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488948+0000", 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7642000000000001e-05 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.496338+0000", 2024-04-26T02:24:53.353 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073895369999999998 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.496445+0000", 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000107544 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 75/31 ECSubWrite(tid=182, reqid=osd.12.0:182, at_version=75'81, trim_to=0'0, roll_forward_to=74'79))", 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:42.805580+0000", 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.478079878999999, 2024-04-26T02:24:53.354 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066234370000000002, 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805580+0000", 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805580+0000", 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.355 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805582+0000", 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8500000000000001e-06 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805635+0000", 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2750999999999997e-05 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805668+0000", 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3127999999999999e-05 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.356 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805691+0000", 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2912e-05 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805956+0000", 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026557000000000002 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.357 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805983+0000", 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6452999999999999e-05 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.812042+0000", 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060590949999999996 2024-04-26T02:24:53.358 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.812204+0000", 2024-04-26T02:24:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016167800000000001 2024-04-26T02:24:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.362 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 75/31 ECSubWrite(tid=183, reqid=osd.12.0:183, at_version=75'83, trim_to=0'0, roll_forward_to=74'79))", 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:42.808330+0000", 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.475329656, 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007019338, 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808330+0000", 2024-04-26T02:24:53.363 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808330+0000", 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808332+0000", 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.846e-06 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.364 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808390+0000", 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7354e-05 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808426+0000", 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6081999999999998e-05 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808449+0000", 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3181999999999999e-05 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808612+0000", 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016351500000000001 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808638+0000", 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5715999999999999e-05 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.815262+0000", 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066237739999999998 2024-04-26T02:24:53.366 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.815350+0000", 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7868999999999995e-05 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 85/31 ECSubWrite(tid=197, reqid=osd.12.0:197, at_version=85'95, trim_to=0'0, roll_forward_to=83'91))", 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.475877+0000", 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.80778330799999998, 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065239909999999998, 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.367 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475877+0000", 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475877+0000", 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.368 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475878+0000", 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.035e-06 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475914+0000", 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6489000000000002e-05 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475937+0000", 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2345e-05 2024-04-26T02:24:53.369 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475950+0000", 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3314e-05 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.476039+0000", 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8914999999999998e-05 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.370 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.476052+0000", 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3183999999999999e-05 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.482342+0000", 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062898299999999997 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.482401+0000", 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8879000000000003e-05 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.371 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.477263+0000", 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.80639654999999999, 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083101059999999994, 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477263+0000", 2024-04-26T02:24:53.372 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477263+0000", 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477265+0000", 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0890000000000001e-06 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.373 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477385+0000", 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000120698 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477406+0000", 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0758999999999999e-05 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477418+0000", 2024-04-26T02:24:53.374 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2335e-05 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477497+0000", 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9170000000000003e-05 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477508+0000", 2024-04-26T02:24:53.375 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0084999999999999e-05 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485536+0000", 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080288059999999994 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.376 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485574+0000", 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7163999999999999e-05 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 85/31 ECSubWrite(tid=142, reqid=osd.13.0:142, at_version=85'67, trim_to=0'0, roll_forward_to=83'63))", 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.485621+0000", 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.79803858400000005, 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006879614, 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.377 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485621+0000", 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.378 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485621+0000", 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485622+0000", 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485649+0000", 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6843999999999999e-05 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.379 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485660+0000", 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1626e-05 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485670+0000", 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6670000000000008e-06 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.487090+0000", 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001419547 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.380 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.487103+0000", 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3553999999999999e-05 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.492431+0000", 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053276210000000003 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.492501+0000", 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0302999999999994e-05 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.381 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.382 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.382 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:53.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:24:53.384 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:53.379+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:53.477 INFO:tasks.rados.rados.0.smithi175.stdout:271: done (10 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:272: done (9 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:273: done (8 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:274: done (7 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:275: done (6 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:277: done (5 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:280: done (4 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:281: done (3 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:283: done (2 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:284: done (1 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:285: done (0 left) 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:286: rollback oid 22 current snap is 28 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 22 to 23 2024-04-26T02:24:53.478 INFO:tasks.rados.rados.0.smithi175.stdout:287: snap_create 2024-04-26T02:24:53.484 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:53.483+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:53.487 INFO:tasks.rados.rados.0.smithi175.stdout:286: finishing rollback tid 0 to smithi17529564-22 2024-04-26T02:24:53.488 INFO:tasks.rados.rados.0.smithi175.stdout:286: finishing rollback tid 1 to smithi17529564-22 2024-04-26T02:24:53.489 INFO:tasks.rados.rados.0.smithi175.stdout:286: finishing rollback tid 2 to smithi17529564-22 2024-04-26T02:24:53.489 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 22 v 62 (ObjNum 97 snap 13 seq_num 97) dirty exists 2024-04-26T02:24:53.518 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:53.518 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:53.518 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:53.519 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:53.533 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:24:53.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:24:53.624 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:53.623+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:53.686 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:53.679+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:53.699 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:53.699 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:53.700 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:53.716 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:24:53.787 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:53.781+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:53.846 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:197 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~589824] snapc 3=[3] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.783595808999998, 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01132682, 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:53.920 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 197 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058676+0000", 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.921 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.058678+0000", 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1119999999999999e-06 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059820+0000", 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011419329999999999 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.922 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059838+0000", 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7312e-05 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.059849+0000", 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1066999999999999e-05 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060084+0000", 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023474499999999999 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.923 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.060231+0000", 2024-04-26T02:24:53.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014785699999999999 2024-04-26T02:24:53.924 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.924 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.924 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.924 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.061250+0000", 2024-04-26T02:24:53.924 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00101822 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.063642+0000", 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00239267 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.069912+0000", 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006269546 2024-04-26T02:24:53.926 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.070003+0000", 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1358000000000002e-05 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.927 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:200 3.5s0 3:a5f188bf:::smithi17529564-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e37)", 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 48.777440141, 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094044490000000005, 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 200 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.928 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064832+0000", 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7700000000000005e-07 2024-04-26T02:24:53.929 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064835+0000", 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6929999999999999e-06 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064844+0000", 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1919999999999994e-06 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.064850+0000", 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0610000000000001e-06 2024-04-26T02:24:53.930 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068037+0000", 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031864490000000001 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.068091+0000", 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4273e-05 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072664+0000", 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004572932 2024-04-26T02:24:53.931 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.072801+0000", 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00013716100000000001 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:05.074236+0000", 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001435211 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.932 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:266 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.708977382999997, 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015257379, 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 266 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.933 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133295+0000", 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133296+0000", 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.313e-06 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.934 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133306+0000", 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.4469999999999995e-06 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133328+0000", 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2439e-05 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.133371+0000", 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2571999999999998e-05 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.935 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.141874+0000", 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0085034459999999996 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.142095+0000", 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000220996 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.148552+0000", 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064571660000000003 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:281 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~524288] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.673340682999999, 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019327321000000001, 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 281 2024-04-26T02:24:53.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168931+0000", 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.168934+0000", 2024-04-26T02:24:53.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4839999999999998e-06 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170027+0000", 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010934390000000001 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170064+0000", 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6295999999999999e-05 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170083+0000", 2024-04-26T02:24:53.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8958999999999999e-05 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170253+0000", 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017040499999999999 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.170531+0000", 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027794499999999998 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.172686+0000", 2024-04-26T02:24:53.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021548629999999999 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174338+0000", 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00165226 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188107+0000", 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013769366999999999 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188259+0000", 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015130300000000001 2024-04-26T02:24:53.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:282 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~524288] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.668988953000003, 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015341766, 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.942 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 282 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173283+0000", 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.173286+0000", 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3700000000000002e-06 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174448+0000", 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011628610000000001 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174480+0000", 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1356000000000003e-05 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174494+0000", 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4462e-05 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174626+0000", 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000132216 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174882+0000", 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000255429 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.945 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.176676+0000", 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0017945190000000001 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186967+0000", 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010290597 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188445+0000", 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001478441 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188625+0000", 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017951499999999999 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:283 3.5s0 3:a5f188bf:::smithi17529564-38:head [append 0~245760] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.667272988999997, 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014380792, 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 283 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.174999+0000", 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175001+0000", 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1840000000000002e-06 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175369+0000", 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000367525 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175391+0000", 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2149000000000001e-05 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175404+0000", 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3293e-05 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178383+0000", 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029786449999999998 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.178546+0000", 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016274200000000001 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.180029+0000", 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014829209999999999 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187286+0000", 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072569109999999996 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.189276+0000", 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0019904459999999999 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.189380+0000", 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000103976 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:284 3.5s0 3:a5f188bf:::smithi17529564-38:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.666842938000002, 2024-04-26T02:24:53.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014822755, 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 284 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:53.953 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175429+0000", 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175430+0000", 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2500000000000001e-06 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175437+0000", 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7429999999999996e-06 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175449+0000", 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1426e-05 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175457+0000", 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4130000000000006e-06 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181434+0000", 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059764500000000003 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.181694+0000", 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026069800000000002 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186398+0000", 2024-04-26T02:24:53.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0047033689999999998 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.187751+0000", 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013529480000000001 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190099+0000", 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023486190000000001 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190252+0000", 2024-04-26T02:24:53.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015283899999999999 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:285 3.5s0 3:a5f188bf:::smithi17529564-38:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.66680264, 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019577975000000001, 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.958 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 285 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175470+0000", 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6700000000000003e-07 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175496+0000", 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5456000000000002e-05 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175509+0000", 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3039e-05 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.175521+0000", 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2597e-05 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190996+0000", 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015474141 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.191226+0000", 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00023018999999999999 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195047+0000", 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038217849999999999 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.5s0 42/31 ECSubWriteReply(tid=51, last_complete=42'39, committed=1, applied=1))", 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 43.662700229000002, 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.009074291, 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179572+0000", 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179573+0000", 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:24:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179579+0000", 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5030000000000002e-06 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179612+0000", 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3361999999999997e-05 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.179631+0000", 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.819e-05 2024-04-26T02:24:53.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188340+0000", 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087091149999999999 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188646+0000", 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030643400000000001 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.965 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:368 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.462456+0000", 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.379815670999999, 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089918250000000002, 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 368 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462456+0000", 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462456+0000", 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462457+0000", 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9299999999999997e-07 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462464+0000", 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6189999999999996e-06 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462475+0000", 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0817e-05 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462482+0000", 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3100000000000003e-06 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462669+0000", 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018740400000000001 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462679+0000", 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.3819999999999993e-06 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.468464+0000", 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057856560000000001 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.468521+0000", 2024-04-26T02:24:53.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7077999999999998e-05 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.471448+0000", 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029268660000000002 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:369 3.5s0 3:ac63ab5a:::smithi17529564-33:head [read 0~540672,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.462494+0000", 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.379777806, 2024-04-26T02:24:53.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094557310000000002, 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 369 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462494+0000", 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462494+0000", 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462495+0000", 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0100000000000005e-07 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462499+0000", 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6430000000000001e-06 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462507+0000", 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3979999999999999e-06 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462514+0000", 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.764e-06 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462719+0000", 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020476000000000001 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.462727+0000", 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.541e-06 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.469121+0000", 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063935870000000001 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.469207+0000", 2024-04-26T02:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6071999999999999e-05 2024-04-26T02:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.471950+0000", 2024-04-26T02:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027433650000000002 2024-04-26T02:24:53.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:384 3.5s0 3:a9520d7f:::smithi17529564-15:head [copy-from ver 2] snapc d=[d,c,6] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.724466+0000", 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.117806413, 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012639683000000001, 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 384 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724466+0000", 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724466+0000", 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724467+0000", 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7599999999999996e-07 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724473+0000", 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.066e-06 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724481+0000", 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9759999999999995e-06 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724487+0000", 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.054e-06 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.981 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724545+0000", 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8729e-05 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724619+0000", 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.3738000000000004e-05 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.732395+0000", 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077759489999999999 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.982 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733725+0000", 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0013303449999999999 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.737016+0000", 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032903089999999999 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.737105+0000", 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9641000000000005e-05 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.983 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:385 3.5s0 3:a9520d7f:::smithi17529564-15:head [stat] snapc 0=[] RETRY=1 ondisk+retry+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.724504+0000", 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.117768244000001, 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088710479999999994, 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 385 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724504+0000", 2024-04-26T02:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724504+0000", 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724505+0000", 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0100000000000005e-07 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724508+0000", 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7510000000000002e-06 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724516+0000", 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.8469999999999996e-06 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724522+0000", 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.1929999999999998e-06 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724742+0000", 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021985200000000001 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.724775+0000", 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2981999999999997e-05 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733229+0000", 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084534899999999993 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733300+0000", 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1721e-05 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.733375+0000", 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4610999999999994e-05 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:417 3.5s0 3:a9520d7f:::smithi17529564-15:head [append 0~442368] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.823567+0000", 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.018705127, 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011059009, 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:53.994 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 417 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.823567+0000", 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:53.995 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.823567+0000", 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.823569+0000", 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.261e-06 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824243+0000", 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00067331699999999999 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:53.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824266+0000", 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3365000000000001e-05 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824277+0000", 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1487e-05 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824376+0000", 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8072000000000006e-05 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.824507+0000", 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000131605 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.825462+0000", 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00095479099999999997 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.826745+0000", 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001283113 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.834529+0000", 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077834990000000001 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.834626+0000", 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7498999999999996e-05 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds4 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:24:53.999 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470039+0000", 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.37223286, 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0092041320000000003, 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470039+0000", 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470039+0000", 2024-04-26T02:24:54.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470040+0000", 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1199999999999999e-07 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470060+0000", 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0832e-05 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470069+0000", 2024-04-26T02:24:54.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4400000000000005e-06 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470075+0000", 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4799999999999998e-06 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470752+0000", 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00067646600000000002 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470770+0000", 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8634000000000002e-05 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479195+0000", 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0084242290000000001 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479243+0000", 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.8739000000000002e-05 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.003 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as6 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 20.371980489999999, 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089483679999999999, 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470292+0000", 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4000000000000001e-07 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470343+0000", 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0643000000000003e-05 2024-04-26T02:24:54.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470364+0000", 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1107999999999998e-05 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470370+0000", 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0349999999999998e-06 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470993+0000", 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00062319199999999995 2024-04-26T02:24:54.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471005+0000", 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1173e-05 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479167+0000", 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081628959999999993 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.479240+0000", 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2581000000000002e-05 2024-04-26T02:24:54.007 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as6 85/31 ECSubWrite(tid=195, reqid=osd.12.0:195, at_version=85'71, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.472468+0000", 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.3698041029999999, 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010536247, 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472468+0000", 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472468+0000", 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472469+0000", 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.58e-07 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.009 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472508+0000", 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9171999999999997e-05 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472532+0000", 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4629000000000001e-05 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472546+0000", 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4102e-05 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.473957+0000", 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001411079 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.473972+0000", 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.464e-05 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.482950+0000", 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089775559999999994 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.483004+0000", 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4611000000000003e-05 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds4 85/31 ECSubWrite(tid=196, reqid=osd.12.0:196, at_version=85'93, trim_to=0'0, roll_forward_to=83'91))", 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.472576+0000", 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.36969644, 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011737286, 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.012 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472576+0000", 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472576+0000", 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472576+0000", 2024-04-26T02:24:54.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9400000000000005e-07 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472600+0000", 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3306999999999999e-05 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472613+0000", 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3254e-05 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.472623+0000", 2024-04-26T02:24:54.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7610000000000002e-06 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.473874+0000", 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001251697 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.473889+0000", 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5007999999999999e-05 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.484277+0000", 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010387356 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.484313+0000", 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6309000000000001e-05 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds4 85/31 ECSubWrite(tid=197, reqid=osd.12.0:197, at_version=85'95, trim_to=0'0, roll_forward_to=83'91))", 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.474633+0000", 2024-04-26T02:24:54.016 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.367639303, 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0097126000000000001, 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474633+0000", 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474633+0000", 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474634+0000", 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.209e-06 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474664+0000", 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9538000000000001e-05 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474681+0000", 2024-04-26T02:24:54.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7512000000000001e-05 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474694+0000", 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2841e-05 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474768+0000", 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4111999999999998e-05 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.474781+0000", 2024-04-26T02:24:54.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3175e-05 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.484318+0000", 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095368190000000002 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.484345+0000", 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7393999999999999e-05 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as6 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.477476+0000", 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.364796374, 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010534296, 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477476+0000", 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477476+0000", 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477477+0000", 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.012e-06 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477597+0000", 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000120364 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477614+0000", 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6612e-05 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477627+0000", 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2729e-05 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477697+0000", 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0629000000000004e-05 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477712+0000", 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.438e-05 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.487976+0000", 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010264282 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.488010+0000", 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4288000000000001e-05 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.024 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.025 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.025 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.025 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:54.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:24:54.027 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:54.025+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:54.127 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:54.127+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:54.145 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:54.154 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:54.154 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:54.154 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:24:54.155 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:54.170 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:24:54.228 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:54.223+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:54.297 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:54.298 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:54.318 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:54.319 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:54.330 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:54.325+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:54.340 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:54.340 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:24:54.340 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:24:54.340 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:24:54.340 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:54.340 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:54.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:24:54.361 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:54.361 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:54.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:54.379 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:54.399 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:54.400 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:54.420 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:54.420 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:54.430 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:54.427+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:54.441 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:54.441 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:54.459 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:54.459 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:54.472 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:24:54.476 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:24:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:24:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:24:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:24:54.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:256 3.as0 3:5c6c7353:::smithi17529564-29:head [delete] snapc 5=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:24:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 44.390464997000002, 2024-04-26T02:24:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014402701, 2024-04-26T02:24:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.477 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 256 2024-04-26T02:24:54.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081135+0000", 2024-04-26T02:24:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081140+0000", 2024-04-26T02:24:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2930000000000002e-06 2024-04-26T02:24:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081191+0000", 2024-04-26T02:24:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1569e-05 2024-04-26T02:24:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081233+0000", 2024-04-26T02:24:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2070999999999998e-05 2024-04-26T02:24:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081259+0000", 2024-04-26T02:24:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5570000000000001e-05 2024-04-26T02:24:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081495+0000", 2024-04-26T02:24:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000236269 2024-04-26T02:24:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.486 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.081510+0000", 2024-04-26T02:24:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4593000000000001e-05 2024-04-26T02:24:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089249+0000", 2024-04-26T02:24:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0077387760000000002 2024-04-26T02:24:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089530+0000", 2024-04-26T02:24:54.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028140800000000003 2024-04-26T02:24:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.091455+0000", 2024-04-26T02:24:54.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001924947 2024-04-26T02:24:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.093895+0000", 2024-04-26T02:24:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002439662 2024-04-26T02:24:54.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.095340+0000", 2024-04-26T02:24:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001445436 2024-04-26T02:24:54.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.095538+0000", 2024-04-26T02:24:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019810699999999999 2024-04-26T02:24:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.492 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:380 3.as0 3:5a9c887b:::smithi17529564-26:head [append 0~81920] snapc d=[d,c,6] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.538440+0000", 2024-04-26T02:24:54.493 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.933160054999998, 2024-04-26T02:24:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094326859999999992, 2024-04-26T02:24:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.494 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 380 2024-04-26T02:24:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.495 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538440+0000", 2024-04-26T02:24:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538440+0000", 2024-04-26T02:24:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538441+0000", 2024-04-26T02:24:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.066e-06 2024-04-26T02:24:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538553+0000", 2024-04-26T02:24:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011124399999999999 2024-04-26T02:24:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538566+0000", 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.313e-05 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538575+0000", 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5270000000000004e-06 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.540453+0000", 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018772839999999999 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.540683+0000", 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000230051 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.542174+0000", 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001491156 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.545570+0000", 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033959229999999999 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.547669+0000", 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020992020000000001 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.547873+0000", 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020410299999999999 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.502 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:381 3.as0 3:5a9c887b:::smithi17529564-26:head [setxattr _header (57) in=7b] snapc d=[d,c,6] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.538593+0000", 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.933007071999999, 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010144986, 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 381 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.503 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538593+0000", 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538593+0000", 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538594+0000", 2024-04-26T02:24:54.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6300000000000004e-07 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538600+0000", 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9699999999999996e-06 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538610+0000", 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0117e-05 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538619+0000", 2024-04-26T02:24:54.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1960000000000008e-06 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.543234+0000", 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046159149999999999 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.543508+0000", 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027357 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.544830+0000", 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001322134 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548359+0000", 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0035286929999999998 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548660+0000", 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030153299999999999 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548738+0000", 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7995000000000001e-05 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:382 3.as0 3:5a9c887b:::smithi17529564-26:head [read 0~1] snapc 0=[] RETRY=1 ondisk+retry+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.538630+0000", 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 31.932970470000001, 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013080127, 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.508 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 382 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538630+0000", 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538630+0000", 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538631+0000", 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.2699999999999998e-07 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538634+0000", 2024-04-26T02:24:54.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3100000000000001e-06 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538644+0000", 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0285999999999999e-05 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.538663+0000", 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8819999999999999e-05 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548282+0000", 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0096185839999999995 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.548353+0000", 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1117000000000004e-05 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.549218+0000", 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00086537599999999995 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.549455+0000", 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000236915 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.551710+0000", 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0022548920000000001 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 59/31 ECSubWrite(tid=68, reqid=osd.15.0:68, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.558911+0000", 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.912689088, 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093286949999999997, 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558911+0000", 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558911+0000", 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558912+0000", 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4499999999999998e-07 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558947+0000", 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5403e-05 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558961+0000", 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3913e-05 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.558974+0000", 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3286e-05 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559097+0000", 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012248000000000001 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559123+0000", 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6562000000000001e-05 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568180+0000", 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0090561889999999992 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568240+0000", 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0516999999999997e-05 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.517 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.6s4 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.559011+0000", 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.912589010000001, 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012271604, 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559011+0000", 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559011+0000", 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559012+0000", 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7100000000000002e-07 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559037+0000", 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5021999999999999e-05 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559050+0000", 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2676e-05 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.559061+0000", 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0774999999999999e-05 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560084+0000", 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010236049999999999 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560098+0000", 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4187e-05 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.571213+0000", 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011114901999999999 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.571283+0000", 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9865999999999998e-05 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.cs2 59/31 ECSubWrite(tid=172, reqid=osd.0.0:172, at_version=59'79, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.876599969000001, 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011057539, 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.522 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595001+0000", 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2099999999999996e-07 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595027+0000", 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5669000000000001e-05 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595039+0000", 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2081e-05 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595047+0000", 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.0700000000000007e-06 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595114+0000", 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6616000000000001e-05 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.525 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595123+0000", 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1079999999999999e-06 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.606019+0000", 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010895930999999999 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.606058+0000", 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.9342999999999999e-05 2024-04-26T02:24:54.526 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:507 3.ds0 3:bba78641:::smithi17529564-30:head [create,setxattr UrPUWbaU]cNfinVtoVUNsYX\\ahn\\oSdRW\\N[RcfO (807) in=40b,setxattr ZQoeVnpeaooblfNZklrg\\hmphZ^pTVh`eRXheade (1225) in=40b,setxattr kcjR][ah`rcmsWjUVlUeaofblgmpleUjjs^]ai\\t (7928) in=40b,setxattr `U^gRRs]UWRVngUaNeN^`p`aVl\\cn_a\\S`iTpOVo (1156) in=40b,setxattr aOYbW^`[gQfVcTQrq[NYeqh\\Q_bjiaWOefngkiNR (1331) in=40b,setxattr igNjm (735) in=5b,setxattr aQYs^c[hafOm^\\g[^R\\^QOd^eiS\\ghimncRcb_pi (15856) in=40b,setxattr dZUpqXmQYdS]obbkNRYdSsdUpenRkjiSSfUmqRTd (9612) in=40b,setxattr lX^flfV^[d^WmlW_UT^kV`s^ahfcNQsT`de`^spi (1612) in=40b,setxattr Ua`UXimY^dWVoQaji\\cZpP^er^hlbYQZs`USR`oh (10033) in=40b,setxattr XhOccedqUYhrPkk[^dVtangb_r^]alTl`ogaOPag (840) in=40b,setxattr YqbXbb\\oPeeR]rqcNaSsS`lkYoffXPcpaqhrb^te (418) in=40b,setxattr jdOeY]PQnfd[iZ^ph\\ijd[WRRnQ^phTpRROYeXss (1611) in=40b,setxattr ie\\ahhoaskiWrasYNh\\mUkqRso\\Olj\\c^P_\\bPp\\ (15577) in=40b,setxattr Ptb\\gnjjhTnd`OQag[dXTYa]t_id[PRpjt_ZfVY] (1541) in=40b,setxattr sSR]a[NPVaUQhPkla[ZVX`lTdim`fgjgeRtm`tt^ (841) in=40b,setxattr _cf[gnNmUkknhenPpY^\\lefOR_n\\mcb`iqOOPUiW (11296) in=40b,setxattr d[TVh[TTre^P`mnfob^WP[dckRkQZafjR[PaW^Zn (8912) in=40b,setxattr X[gWOjQtntoVfbZV[UObOVPoj`qib[[Zt]trgVjh (1542) in=40b,setxattr _qa\\VSbX\\\\b`tO_lSRnsf`PVNfmPkWrf[P\\ZTej[ (453) in=40b] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:27.467642+0000", 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.003958145999999, 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014433382, 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.527 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 507 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467642+0000", 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467642+0000", 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467646+0000", 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5580000000000001e-06 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467838+0000", 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019233 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467873+0000", 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4328000000000001e-05 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.467898+0000", 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5778999999999998e-05 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.468051+0000", 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015306 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.468062+0000", 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0564000000000001e-05 2024-04-26T02:24:54.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.471010+0000", 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029476680000000001 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.471234+0000", 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000224121 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.473028+0000", 2024-04-26T02:24:54.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001794138 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.477320+0000", 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0042916209999999998 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481900+0000", 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0045803679999999996 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.482076+0000", 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000175847 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:571 3.as0 3:5a56b440:::smithi17529564-4:head [append 0~0] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:37.577513+0000", 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.894087519999999, 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0099776529999999995, 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.533 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 571 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577513+0000", 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577513+0000", 2024-04-26T02:24:54.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577516+0000", 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7269999999999999e-06 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577527+0000", 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0909e-05 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577544+0000", 2024-04-26T02:24:54.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7626e-05 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577556+0000", 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2064e-05 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.578559+0000", 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010026449999999999 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.578705+0000", 2024-04-26T02:24:54.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014647999999999999 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.579913+0000", 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012078830000000001 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.586970+0000", 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070571410000000003 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.587402+0000", 2024-04-26T02:24:54.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00043182700000000002 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.587491+0000", 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8350999999999995e-05 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:572 3.as0 3:5a56b440:::smithi17529564-4:head [rollback 12] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:37.577590+0000", 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.894010099999999, 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.015976830000000001, 2024-04-26T02:24:54.538 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 572 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577590+0000", 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577590+0000", 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577591+0000", 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.23e-07 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577596+0000", 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9699999999999998e-06 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577612+0000", 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5994999999999998e-05 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577622+0000", 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.5959999999999993e-06 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.580875+0000", 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0032533729999999999 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.581154+0000", 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027908799999999998 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.582733+0000", 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001578533 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.587067+0000", 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0043338120000000003 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593507+0000", 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064405010000000004 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593567+0000", 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0139000000000001e-05 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:573 3.as0 3:5a56b440:::smithi17529564-4:head [append 0~0] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:24:54.543 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.893963831000001, 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01603773, 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 573 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:54.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577637+0000", 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6199999999999997e-07 2024-04-26T02:24:54.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577641+0000", 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0840000000000002e-06 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577653+0000", 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1299e-05 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.577682+0000", 2024-04-26T02:24:54.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8946999999999999e-05 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.583676+0000", 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059947940000000003 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.583947+0000", 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000270778 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.585441+0000", 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0014937150000000001 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593315+0000", 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0078738509999999994 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593631+0000", 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000316607 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.548 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:37.593674+0000", 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2993e-05 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:584 3.ds0 3:bac6342f:::smithi17529564-32:head [append 0~0] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.484427+0000", 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.987173171, 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018432351, 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.549 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 584 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484427+0000", 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484427+0000", 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484430+0000", 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2400000000000002e-06 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484441+0000", 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1099e-05 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484470+0000", 2024-04-26T02:24:54.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9298999999999998e-05 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484485+0000", 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4686e-05 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484645+0000", 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016049799999999999 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484930+0000", 2024-04-26T02:24:54.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00028535099999999999 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.487097+0000", 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0021664509999999998 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.502057+0000", 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01496046 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.502663+0000", 2024-04-26T02:24:54.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00060518699999999998 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.502860+0000", 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019708 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:585 3.ds0 3:bac6342f:::smithi17529564-32:head [rollback 12] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.484574+0000", 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.987026572, 2024-04-26T02:24:54.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019097864999999999, 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 585 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484574+0000", 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484574+0000", 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484575+0000", 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4130000000000001e-06 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484583+0000", 2024-04-26T02:24:54.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5599999999999996e-06 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484600+0000", 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7379000000000001e-05 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484611+0000", 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0529e-05 2024-04-26T02:24:54.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.489906+0000", 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0052948029999999998 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.490153+0000", 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00024708999999999999 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491665+0000", 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015118659999999999 2024-04-26T02:24:54.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.503000+0000", 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011335034000000001 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.503397+0000", 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039774199999999997 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.503672+0000", 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027444900000000001 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:586 3.ds0 3:bac6342f:::smithi17529564-32:head [append 0~0] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.484940+0000", 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.986660338, 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.019958755000000002, 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.560 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 586 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484940+0000", 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484940+0000", 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484942+0000", 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1059999999999998e-06 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484953+0000", 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0366e-05 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.484999+0000", 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6480999999999998e-05 2024-04-26T02:24:54.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.485015+0000", 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5588999999999999e-05 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.498900+0000", 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013885718 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.563 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.499190+0000", 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029002200000000002 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.500284+0000", 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001093541 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.564 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.504519+0000", 2024-04-26T02:24:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.004235389 2024-04-26T02:24:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.504720+0000", 2024-04-26T02:24:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000200206 2024-04-26T02:24:54.565 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.504899+0000", 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017933700000000001 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 71/31 ECSubWriteReply(tid=154, last_complete=71'62, committed=1, applied=1))", 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.491079+0000", 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.980521234999999, 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.01032724, 2024-04-26T02:24:54.566 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491079+0000", 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491079+0000", 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.567 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491081+0000", 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.894e-06 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491092+0000", 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0886e-05 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491124+0000", 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1511999999999999e-05 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.568 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491144+0000", 2024-04-26T02:24:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0338000000000001e-05 2024-04-26T02:24:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.501350+0000", 2024-04-26T02:24:54.569 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010205815999999999 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.501406+0000", 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6793999999999999e-05 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.570 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 71/31 ECSubWriteReply(tid=154, last_complete=71'62, committed=1, applied=1))", 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.491767+0000", 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.979833522, 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010296924000000001, 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491767+0000", 2024-04-26T02:24:54.571 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491767+0000", 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491769+0000", 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9400000000000001e-06 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.572 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491782+0000", 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2716e-05 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491813+0000", 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0959e-05 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.491835+0000", 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2535e-05 2024-04-26T02:24:54.573 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.501486+0000", 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0096505759999999993 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.502064+0000", 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00057819800000000004 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.574 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 71/31 ECSubWriteReply(tid=154, last_complete=71'62, committed=1, applied=1))", 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.492026+0000", 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.979574626, 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0096311899999999995, 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.492026+0000", 2024-04-26T02:24:54.575 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.492026+0000", 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.492027+0000", 2024-04-26T02:24:54.576 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3e-06 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.492036+0000", 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.8000000000000004e-06 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.492062+0000", 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5701999999999999e-05 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.492079+0000", 2024-04-26T02:24:54.577 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7125999999999998e-05 2024-04-26T02:24:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.501594+0000", 2024-04-26T02:24:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095156389999999993 2024-04-26T02:24:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.578 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.501657+0000", 2024-04-26T02:24:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.2623e-05 2024-04-26T02:24:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.579 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWriteReply(3.ds0 71/31 ECSubWriteReply(tid=154, last_complete=71'62, committed=1, applied=1))", 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.494238+0000", 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.977362764, 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0094378399999999994, 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.580 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.494238+0000", 2024-04-26T02:24:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.581 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.494238+0000", 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.494240+0000", 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1129999999999999e-06 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.494253+0000", 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.331e-05 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.494288+0000", 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4690999999999997e-05 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.584 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.494312+0000", 2024-04-26T02:24:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4358999999999998e-05 2024-04-26T02:24:54.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.501991+0000", 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076784310000000003 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.587 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.503676+0000", 2024-04-26T02:24:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0016849359999999999 2024-04-26T02:24:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.588 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:600 3.as0 3:5a56b440:::smithi17529564-4:head [copy-from ver 26] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.534308+0000", 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 15.937292155, 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011083766, 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.589 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 600 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534308+0000", 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534308+0000", 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534311+0000", 2024-04-26T02:24:54.591 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.8629999999999999e-06 2024-04-26T02:24:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534325+0000", 2024-04-26T02:24:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3873000000000001e-05 2024-04-26T02:24:54.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534354+0000", 2024-04-26T02:24:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9091e-05 2024-04-26T02:24:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534369+0000", 2024-04-26T02:24:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5063e-05 2024-04-26T02:24:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534520+0000", 2024-04-26T02:24:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000150443 2024-04-26T02:24:54.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.534611+0000", 2024-04-26T02:24:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1119000000000006e-05 2024-04-26T02:24:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.538762+0000", 2024-04-26T02:24:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041515959999999996 2024-04-26T02:24:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.597 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.541830+0000", 2024-04-26T02:24:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030679800000000001 2024-04-26T02:24:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.598 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.545317+0000", 2024-04-26T02:24:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0034869950000000001 2024-04-26T02:24:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.599 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.545392+0000", 2024-04-26T02:24:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4742999999999999e-05 2024-04-26T02:24:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.600 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:707 3.as0 3:5a56b440:::smithi17529564-4:head [rmxattr UXV`NXQYomt]eTei[ksqfOr_cm in=26b,rmxattr WZUeZrcUPqodUr`\\UmkgYpXpr[W^ceZRfhO\\nRaj in=40b,rmxattr WtRNQ`NYWWmoWpjVqhb]\\apOq]RTUbOfshmUmtTR in=40b,rmxattr dobiNs^RXTPjhaQtOaipXXfdWQYafcajclaW`TiO in=40b,rmxattr hmNTeiNaYhNQOPaRafS\\N[Q\\lni in=27b,rmxattr lhackQeZc^aYSZgjq][O[rfV\\cgsZ[tah_Q_cX\\h in=40b,rmxattr nqoachfoWSY`OSgs_VoZTbhe]egYaQiZl[RTphVr in=40b,rmxattr sVZOOgbVN`ejVfhSRZcaTtqnfdgPbpaYeNQbSf`c in=40b] snapc 1c=[1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-26T02:24:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.475543+0000", 2024-04-26T02:24:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.9960576489999999, 2024-04-26T02:24:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.022984174, 2024-04-26T02:24:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:24:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:24:54.601 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:24:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:24:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 707 2024-04-26T02:24:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.602 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:24:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:24:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475543+0000", 2024-04-26T02:24:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.603 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:24:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475543+0000", 2024-04-26T02:24:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:24:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.604 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:24:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475545+0000", 2024-04-26T02:24:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9999999999999999e-06 2024-04-26T02:24:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:24:54.605 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475552+0000", 2024-04-26T02:24:54.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.447e-06 2024-04-26T02:24:54.606 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.606 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.606 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:24:54.606 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475572+0000", 2024-04-26T02:24:54.606 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9769e-05 2024-04-26T02:24:54.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.607 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.607 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:24:54.607 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475583+0000", 2024-04-26T02:24:54.607 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1167e-05 2024-04-26T02:24:54.607 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475698+0000", 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000114444 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.475869+0000", 2024-04-26T02:24:54.608 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017084199999999999 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477246+0000", 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001377477 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.609 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.484133+0000", 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068869150000000004 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.498440+0000", 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014307118000000001 2024-04-26T02:24:54.610 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.498527+0000", 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6995000000000003e-05 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.611 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:24:54.612 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:24:54.612 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:24:54.614 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:54.614 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:54.615 INFO:tasks.rados.rados.0.smithi175.stdout:286: done (1 left) 2024-04-26T02:24:54.615 INFO:tasks.rados.rados.0.smithi175.stdout:287: done (0 left) 2024-04-26T02:24:54.615 INFO:tasks.rados.rados.0.smithi175.stdout:288: rollback oid 20 current snap is 29 2024-04-26T02:24:54.616 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 20 to 24 2024-04-26T02:24:54.616 INFO:tasks.rados.rados.0.smithi175.stdout:289: snap_create 2024-04-26T02:24:54.616 INFO:tasks.rados.rados.0.smithi175.stdout:288: finishing rollback tid 0 to smithi17529564-20 2024-04-26T02:24:54.616 INFO:tasks.rados.rados.0.smithi175.stdout:288: finishing rollback tid 1 to smithi17529564-20 2024-04-26T02:24:54.616 INFO:tasks.rados.rados.0.smithi175.stdout:288: finishing rollback tid 2 to smithi17529564-20 2024-04-26T02:24:54.616 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 20 v 66 (ObjNum 121 snap 22 seq_num 121) dirty exists 2024-04-26T02:24:54.617 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:24:54.618 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:54.618 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:54.619 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:54.619 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:54.620 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:54.620 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:54.620 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:54.621 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:54.621 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:54.622 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:54.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:54.607+0000 7f33d2438640 0 -- 172.21.15.59:0/1493182960 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f33cc223340 msgr2=0x7f33cc225730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-26T02:24:54.622 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:54.611+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:54.623 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:54.623 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:54.714 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:54.711+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:54.749 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:54.749 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:54.763 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:24:54.815 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:54.811+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:54.881 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:54.881 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:54.896 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:24:54.916 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:54.911+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:55.012 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:55.012 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:55.016 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:55.013+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:55.027 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:24:55.117 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:55.117+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:55.145 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:55.145 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:55.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:24:55.219 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:55.215+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:55.280 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:55.280 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:55.294 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:24:55.335 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:55.331+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:55.421 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:55.415+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:55.454 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:55.454 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:55.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:24:55.482 INFO:tasks.rados.rados.0.smithi175.stdout:288: done (1 left) 2024-04-26T02:24:55.482 INFO:tasks.rados.rados.0.smithi175.stdout:289: done (0 left) 2024-04-26T02:24:55.482 INFO:tasks.rados.rados.0.smithi175.stdout:290: rollback oid 33 current snap is 30 2024-04-26T02:24:55.483 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 33 to 28 2024-04-26T02:24:55.483 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 18 current snap is 30 2024-04-26T02:24:55.483 INFO:tasks.rados.rados.0.smithi175.stdout:291: seq_num 133 ranges {294912=688128,983040=720896,1703936=475136,2179072=360448} 2024-04-26T02:24:55.501 INFO:tasks.rados.rados.0.smithi175.stdout:291: writing smithi17529564-18 from 294912 to 983040 tid 1 2024-04-26T02:24:55.515 INFO:tasks.rados.rados.0.smithi175.stdout:291: writing smithi17529564-18 from 983040 to 1703936 tid 2 2024-04-26T02:24:55.522 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:55.519+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:55.524 INFO:tasks.rados.rados.0.smithi175.stdout:291: writing smithi17529564-18 from 1703936 to 2179072 tid 3 2024-04-26T02:24:55.531 INFO:tasks.rados.rados.0.smithi175.stdout:291: writing smithi17529564-18 from 2179072 to 2539520 tid 4 2024-04-26T02:24:55.531 INFO:tasks.rados.rados.0.smithi175.stdout:292: read oid 13 snap -1 2024-04-26T02:24:55.531 INFO:tasks.rados.rados.0.smithi175.stdout:292: expect (ObjNum 86 snap 12 seq_num 86) 2024-04-26T02:24:55.531 INFO:tasks.rados.rados.0.smithi175.stdout:293: read oid 27 snap -1 2024-04-26T02:24:55.531 INFO:tasks.rados.rados.0.smithi175.stdout:293: expect (ObjNum 0 snap 0 seq_num 0) 2024-04-26T02:24:55.532 INFO:tasks.rados.rados.0.smithi175.stdout:294: snap_create 2024-04-26T02:24:55.532 INFO:tasks.rados.rados.0.smithi175.stdout:290: finishing rollback tid 0 to smithi17529564-33 2024-04-26T02:24:55.532 INFO:tasks.rados.rados.0.smithi175.stdout:290: finishing rollback tid 1 to smithi17529564-33 2024-04-26T02:24:55.532 INFO:tasks.rados.rados.0.smithi175.stdout:290: finishing rollback tid 2 to smithi17529564-33 2024-04-26T02:24:55.533 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 33 v 65 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-04-26T02:24:55.533 INFO:tasks.rados.rados.0.smithi175.stdout:291: finishing write tid 1 to smithi17529564-18 2024-04-26T02:24:55.533 INFO:tasks.rados.rados.0.smithi175.stdout:291: finishing write tid 2 to smithi17529564-18 2024-04-26T02:24:55.533 INFO:tasks.rados.rados.0.smithi175.stdout:291: finishing write tid 3 to smithi17529564-18 2024-04-26T02:24:55.534 INFO:tasks.rados.rados.0.smithi175.stdout:293: expect (ObjNum 0 snap 0 seq_num 0) 2024-04-26T02:24:55.548 INFO:tasks.rados.rados.0.smithi175.stdout:291: finishing write tid 4 to smithi17529564-18 2024-04-26T02:24:55.548 INFO:tasks.rados.rados.0.smithi175.stdout:291: finishing write tid 5 to smithi17529564-18 2024-04-26T02:24:55.548 INFO:tasks.rados.rados.0.smithi175.stdout:291: finishing write tid 6 to smithi17529564-18 2024-04-26T02:24:55.548 INFO:tasks.rados.rados.0.smithi175.stdout:291: oid 18 updating version 0 to 151 2024-04-26T02:24:55.548 INFO:tasks.rados.rados.0.smithi175.stdout:291: oid 18 version 151 is already newer than 148 2024-04-26T02:24:55.549 INFO:tasks.rados.rados.0.smithi175.stdout:291: oid 18 updating version 151 to 152 2024-04-26T02:24:55.549 INFO:tasks.rados.rados.0.smithi175.stdout:291: oid 18 version 152 is already newer than 150 2024-04-26T02:24:55.549 INFO:tasks.rados.rados.0.smithi175.stdout:291: oid 18 version 152 is already newer than 149 2024-04-26T02:24:55.549 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 18 v 152 (ObjNum 133 snap 30 seq_num 133) dirty exists 2024-04-26T02:24:55.549 INFO:tasks.rados.rados.0.smithi175.stdout:291: left oid 18 (ObjNum 133 snap 30 seq_num 133) 2024-04-26T02:24:55.558 INFO:tasks.rados.rados.0.smithi175.stdout:292: expect (ObjNum 86 snap 12 seq_num 86) 2024-04-26T02:24:55.596 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:55.596 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:55.611 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:24:55.655 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:55.651+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:55.723 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:55.721+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:55.733 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:55.733 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:55.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:24:55.835 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:55.831+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:55.914 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:55.914 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:55.925 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:55.919+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:55.928 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:24:56.026 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:56.023+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:56.099 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:56.099 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:56.113 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:24:56.127 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:56.121+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:56.228 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:56.225+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:56.238 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:56.239 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:56.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:24:56.329 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:56.327+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:56.371 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:24:56.371 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:24:56.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:24:56.378 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:56.378 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:56.393 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:24:56.430 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:56.425+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:290: done (4 left) 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:291: done (3 left) 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:292: done (2 left) 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:293: done (1 left) 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:294: done (0 left) 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:295: rollback oid 30 current snap is 31 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 30 to 14 2024-04-26T02:24:56.485 INFO:tasks.rados.rados.0.smithi175.stdout:296: snap_remove snap 28 2024-04-26T02:24:56.527 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:56.527 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:56.530 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:56.527+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:56.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:24:56.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T02:24:56.632 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:56.631+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:56.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:24:56.661 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:56.662 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:56.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:24:56.695 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:24:56.695 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:24:56.716 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-04-26T02:24:56.478434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":108331552,"num_objects":81,"num_object_clones":33,"num_object_copies":557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":6,"num_read":428,"num_read_kb":93072,"num_write":816,"num_write_kb":118356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1102,"ondisk_log_size":1102,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":662392,"kb_used_data":200888,"kb_used_omap":24,"kb_used_meta":461223,"kb_avail":1509287048,"statfs":{"total":1546188226560,"available":1545509937152,"internally_reserved":0,"allocated":205709312,"data_stored":260674725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25517,"internal_metadata":472292435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3899392,"num_objects":3,"num_object_clones":3,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":2066,"num_write":14,"num_write_kb":3808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.009641"},"pg_stats":[{"pgid":"3.f","version":"85'68","reported_seq":350,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.483647+0000","last_change":"2024-04-26T02:24:52.508242+0000","last_active":"2024-04-26T02:24:53.483647+0000","last_peered":"2024-04-26T02:24:53.483647+0000","last_clean":"2024-04-26T02:24:53.483647+0000","last_became_active":"2024-04-26T02:24:00.374359+0000","last_became_peered":"2024-04-26T02:24:00.374359+0000","last_unstale":"2024-04-26T02:24:53.483647+0000","last_undegraded":"2024-04-26T02:24:53.483647+0000","last_fullsized":"2024-04-26T02:24:53.483647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.398218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026678767999999999,"stat_sum":{"num_bytes":8323072,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":9131,"num_write":29,"num_write_kb":10064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,14,2,1,3],"acting":[0,13,5,14,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"3.e","version":"83'63","reported_seq":325,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.585402+0000","last_change":"2024-04-26T02:24:51.586312+0000","last_active":"2024-04-26T02:24:51.585402+0000","last_peered":"2024-04-26T02:24:51.585402+0000","last_clean":"2024-04-26T02:24:51.585402+0000","last_became_active":"2024-04-26T02:24:00.146609+0000","last_became_peered":"2024-04-26T02:24:00.146609+0000","last_unstale":"2024-04-26T02:24:51.585402+0000","last_undegraded":"2024-04-26T02:24:51.585402+0000","last_fullsized":"2024-04-26T02:24:51.585402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.352455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015635270000000001,"stat_sum":{"num_bytes":6438912,"num_objects":5,"num_object_clones":3,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":1007,"num_write":44,"num_write_kb":6848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,14,6,4,11,9,15],"acting":[13,14,6,4,11,9,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"3.d","version":"85'95","reported_seq":370,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.511849+0000","last_change":"2024-04-26T02:24:52.489674+0000","last_active":"2024-04-26T02:24:53.511849+0000","last_peered":"2024-04-26T02:24:53.511849+0000","last_clean":"2024-04-26T02:24:53.511849+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:24:53.511849+0000","last_undegraded":"2024-04-26T02:24:53.511849+0000","last_fullsized":"2024-04-26T02:24:53.511849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:04.508086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018683485,"stat_sum":{"num_bytes":15384576,"num_objects":8,"num_object_clones":3,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":29,"num_read_kb":4623,"num_write":66,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"3.c","version":"85'146","reported_seq":429,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.483696+0000","last_change":"2024-04-26T02:24:52.529901+0000","last_active":"2024-04-26T02:24:53.483696+0000","last_peered":"2024-04-26T02:24:53.483696+0000","last_clean":"2024-04-26T02:24:53.483696+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:24:53.483696+0000","last_undegraded":"2024-04-26T02:24:53.483696+0000","last_fullsized":"2024-04-26T02:24:53.483696+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.603490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.048971342000000001,"stat_sum":{"num_bytes":18563072,"num_objects":14,"num_object_clones":6,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":2,"num_read":55,"num_read_kb":41303,"num_write":61,"num_write_kb":18128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"3.b","version":"83'35","reported_seq":299,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.581704+0000","last_change":"2024-04-26T02:24:51.582611+0000","last_active":"2024-04-26T02:24:51.581704+0000","last_peered":"2024-04-26T02:24:51.581704+0000","last_clean":"2024-04-26T02:24:51.581704+0000","last_became_active":"2024-04-26T02:24:00.090396+0000","last_became_peered":"2024-04-26T02:24:00.090396+0000","last_unstale":"2024-04-26T02:24:51.581704+0000","last_undegraded":"2024-04-26T02:24:51.581704+0000","last_fullsized":"2024-04-26T02:24:51.581704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:22.038768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001141789,"stat_sum":{"num_bytes":3309568,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":8,"num_read_kb":5,"num_write":38,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,14],"acting":[7,15,10,12,1,4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"3.a","version":"85'73","reported_seq":339,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.511836+0000","last_change":"2024-04-26T02:24:52.485704+0000","last_active":"2024-04-26T02:24:53.511836+0000","last_peered":"2024-04-26T02:24:53.511836+0000","last_clean":"2024-04-26T02:24:53.511836+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:24:53.511836+0000","last_undegraded":"2024-04-26T02:24:53.511836+0000","last_fullsized":"2024-04-26T02:24:53.511836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:04.097541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.014968486,"stat_sum":{"num_bytes":4292608,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":53,"num_write_kb":4656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"3.9","version":"84'50","reported_seq":315,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.598195+0000","last_change":"2024-04-26T02:24:51.600114+0000","last_active":"2024-04-26T02:24:51.598195+0000","last_peered":"2024-04-26T02:24:51.598195+0000","last_clean":"2024-04-26T02:24:51.598195+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:24:51.598195+0000","last_undegraded":"2024-04-26T02:24:51.598195+0000","last_fullsized":"2024-04-26T02:24:51.598195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:09.554623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013873465999999999,"stat_sum":{"num_bytes":4210688,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":17,"num_read_kb":247,"num_write":60,"num_write_kb":5376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"3.8","version":"84'84","reported_seq":345,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.612351+0000","last_change":"2024-04-26T02:24:51.614225+0000","last_active":"2024-04-26T02:24:51.612351+0000","last_peered":"2024-04-26T02:24:51.612351+0000","last_clean":"2024-04-26T02:24:51.612351+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:24:51.612351+0000","last_undegraded":"2024-04-26T02:24:51.612351+0000","last_fullsized":"2024-04-26T02:24:51.612351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.273598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.017756755999999999,"stat_sum":{"num_bytes":9945088,"num_objects":8,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":3131,"num_write":54,"num_write_kb":8464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"1.0","version":"26'157","reported_seq":323,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.600078+0000","last_change":"2024-04-26T02:23:47.990299+0000","last_active":"2024-04-26T02:24:51.600078+0000","last_peered":"2024-04-26T02:24:51.600078+0000","last_clean":"2024-04-26T02:24:51.600078+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:24:51.600078+0000","last_undegraded":"2024-04-26T02:24:51.600078+0000","last_fullsized":"2024-04-26T02:24:51.600078+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:23:46.869793+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:03.807128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":123,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.571747+0000","last_change":"2024-04-26T02:23:51.662365+0000","last_active":"2024-04-26T02:24:51.571747+0000","last_peered":"2024-04-26T02:24:51.571747+0000","last_clean":"2024-04-26T02:24:51.571747+0000","last_became_active":"2024-04-26T02:23:51.661700+0000","last_became_peered":"2024-04-26T02:23:51.661700+0000","last_unstale":"2024-04-26T02:24:51.571747+0000","last_undegraded":"2024-04-26T02:24:51.571747+0000","last_fullsized":"2024-04-26T02:24:51.571747+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.138235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.2","version":"82'54","reported_seq":314,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.571845+0000","last_change":"2024-04-26T02:24:51.572463+0000","last_active":"2024-04-26T02:24:51.571845+0000","last_peered":"2024-04-26T02:24:51.571845+0000","last_clean":"2024-04-26T02:24:51.571845+0000","last_became_active":"2024-04-26T02:24:00.372767+0000","last_became_peered":"2024-04-26T02:24:00.372767+0000","last_unstale":"2024-04-26T02:24:51.571845+0000","last_undegraded":"2024-04-26T02:24:51.571845+0000","last_fullsized":"2024-04-26T02:24:51.571845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:26.868915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009934989999999999,"stat_sum":{"num_bytes":4046848,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":5984,"num_write":22,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,5,0,4,8,10,13],"acting":[14,5,0,4,8,10,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.481959+0000","last_change":"2024-04-26T02:23:51.065908+0000","last_active":"2024-04-26T02:24:53.481959+0000","last_peered":"2024-04-26T02:24:53.481959+0000","last_clean":"2024-04-26T02:24:53.481959+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:24:53.481959+0000","last_undegraded":"2024-04-26T02:24:53.481959+0000","last_fullsized":"2024-04-26T02:24:53.481959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:53.500856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"85'65","reported_seq":343,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T02:24:55.656606+0000","last_change":"2024-04-26T02:24:52.515016+0000","last_active":"2024-04-26T02:24:55.656606+0000","last_peered":"2024-04-26T02:24:55.656606+0000","last_clean":"2024-04-26T02:24:55.656606+0000","last_became_active":"2024-04-26T02:24:00.149098+0000","last_became_peered":"2024-04-26T02:24:00.149098+0000","last_unstale":"2024-04-26T02:24:55.656606+0000","last_undegraded":"2024-04-26T02:24:55.656606+0000","last_fullsized":"2024-04-26T02:24:55.656606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.172886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.041924110000000001,"stat_sum":{"num_bytes":11026432,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13209,"num_write":27,"num_write_kb":11456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,14,10,9,1,3],"acting":[11,4,14,10,9,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":123,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.571250+0000","last_change":"2024-04-26T02:23:50.926756+0000","last_active":"2024-04-26T02:24:51.571250+0000","last_peered":"2024-04-26T02:24:51.571250+0000","last_clean":"2024-04-26T02:24:51.571250+0000","last_became_active":"2024-04-26T02:23:50.925932+0000","last_became_peered":"2024-04-26T02:23:50.925932+0000","last_unstale":"2024-04-26T02:24:51.571250+0000","last_undegraded":"2024-04-26T02:24:51.571250+0000","last_fullsized":"2024-04-26T02:24:51.571250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:08.606203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"3.0","version":"84'49","reported_seq":314,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.596765+0000","last_change":"2024-04-26T02:24:51.598277+0000","last_active":"2024-04-26T02:24:51.596765+0000","last_peered":"2024-04-26T02:24:51.596765+0000","last_clean":"2024-04-26T02:24:51.596765+0000","last_became_active":"2024-04-26T02:24:00.306559+0000","last_became_peered":"2024-04-26T02:24:00.306559+0000","last_unstale":"2024-04-26T02:24:51.596765+0000","last_undegraded":"2024-04-26T02:24:51.596765+0000","last_fullsized":"2024-04-26T02:24:51.596765+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.446374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.013848086000000001,"stat_sum":{"num_bytes":8994816,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":2361,"num_write":27,"num_write_kb":8784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,14,15],"acting":[1,9,4,2,6,14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"2.2","version":"0'0","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.483316+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:24:53.483316+0000","last_peered":"2024-04-26T02:24:53.483316+0000","last_clean":"2024-04-26T02:24:53.483316+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:24:53.483316+0000","last_undegraded":"2024-04-26T02:24:53.483316+0000","last_fullsized":"2024-04-26T02:24:53.483316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":274,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T02:24:55.656650+0000","last_change":"2024-04-26T02:24:52.479082+0000","last_active":"2024-04-26T02:24:55.656650+0000","last_peered":"2024-04-26T02:24:55.656650+0000","last_clean":"2024-04-26T02:24:55.656650+0000","last_became_active":"2024-04-26T02:24:00.305653+0000","last_became_peered":"2024-04-26T02:24:00.305653+0000","last_unstale":"2024-04-26T02:24:55.656650+0000","last_undegraded":"2024-04-26T02:24:55.656650+0000","last_fullsized":"2024-04-26T02:24:55.656650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.099040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018033820000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,12],"acting":[10,8,11,0,1,2,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"3.5","version":"85'61","reported_seq":344,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.482576+0000","last_change":"2024-04-26T02:24:52.503635+0000","last_active":"2024-04-26T02:24:53.482576+0000","last_peered":"2024-04-26T02:24:53.482576+0000","last_clean":"2024-04-26T02:24:53.482576+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:24:53.482576+0000","last_undegraded":"2024-04-26T02:24:53.482576+0000","last_fullsized":"2024-04-26T02:24:53.482576+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.886633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026532789000000001,"stat_sum":{"num_bytes":3473408,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":29,"num_read_kb":4831,"num_write":67,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-04-26T02:24:55.656514+0000","last_change":"2024-04-26T02:23:50.927505+0000","last_active":"2024-04-26T02:24:55.656514+0000","last_peered":"2024-04-26T02:24:55.656514+0000","last_clean":"2024-04-26T02:24:55.656514+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:24:55.656514+0000","last_undegraded":"2024-04-26T02:24:55.656514+0000","last_fullsized":"2024-04-26T02:24:55.656514+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:05.943067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":260,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.581793+0000","last_change":"2024-04-26T02:24:51.582247+0000","last_active":"2024-04-26T02:24:51.581793+0000","last_peered":"2024-04-26T02:24:51.581793+0000","last_clean":"2024-04-26T02:24:51.581793+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:24:51.581793+0000","last_undegraded":"2024-04-26T02:24:51.581793+0000","last_fullsized":"2024-04-26T02:24:51.581793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:11.144314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00069533300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":122,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.573084+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:24:51.573084+0000","last_peered":"2024-04-26T02:24:51.573084+0000","last_clean":"2024-04-26T02:24:51.573084+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:24:51.573084+0000","last_undegraded":"2024-04-26T02:24:51.573084+0000","last_fullsized":"2024-04-26T02:24:51.573084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"85'42","reported_seq":310,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.474193+0000","last_change":"2024-04-26T02:24:52.516910+0000","last_active":"2024-04-26T02:24:53.474193+0000","last_peered":"2024-04-26T02:24:53.474193+0000","last_clean":"2024-04-26T02:24:53.474193+0000","last_became_active":"2024-04-26T02:24:00.009169+0000","last_became_peered":"2024-04-26T02:24:00.009169+0000","last_unstale":"2024-04-26T02:24:53.474193+0000","last_undegraded":"2024-04-26T02:24:53.474193+0000","last_fullsized":"2024-04-26T02:24:53.474193+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:22.286061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.034138470999999997,"stat_sum":{"num_bytes":2998272,"num_objects":4,"num_object_clones":2,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":2928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,14,10,0],"acting":[3,13,6,7,14,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"11","length":"1"},{"start":"13","length":"1"},{"start":"18","length":"1"},{"start":"1b","length":"2"}]},{"pgid":"2.6","version":"0'0","reported_seq":122,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.588288+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:24:51.588288+0000","last_peered":"2024-04-26T02:24:51.588288+0000","last_clean":"2024-04-26T02:24:51.588288+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:24:51.588288+0000","last_undegraded":"2024-04-26T02:24:51.588288+0000","last_fullsized":"2024-04-26T02:24:51.588288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"66'60","reported_seq":324,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-26T02:24:51.588724+0000","last_change":"2024-04-26T02:24:51.589645+0000","last_active":"2024-04-26T02:24:51.588724+0000","last_peered":"2024-04-26T02:24:51.588724+0000","last_clean":"2024-04-26T02:24:51.588724+0000","last_became_active":"2024-04-26T02:24:00.306813+0000","last_became_peered":"2024-04-26T02:24:00.306813+0000","last_unstale":"2024-04-26T02:24:51.588724+0000","last_undegraded":"2024-04-26T02:24:51.588724+0000","last_fullsized":"2024-04-26T02:24:51.588724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:27.494050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012092990000000001,"stat_sum":{"num_bytes":6733824,"num_objects":4,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":7113,"num_write":51,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,14,6,2,12,0,1],"acting":[15,14,6,2,12,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"12","length":"3"},{"start":"17","length":"2"},{"start":"1b","length":"2"}]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-26T02:24:53.482358+0000","last_change":"2024-04-26T02:23:50.925194+0000","last_active":"2024-04-26T02:24:53.482358+0000","last_peered":"2024-04-26T02:24:53.482358+0000","last_clean":"2024-04-26T02:24:53.482358+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:24:53.482358+0000","last_undegraded":"2024-04-26T02:24:53.482358+0000","last_fullsized":"2024-04-26T02:24:53.482358+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:00.556874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":107741184,"num_objects":79,"num_object_clones":33,"num_object_copies":553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":6,"num_read":292,"num_read_kb":92954,"num_write":613,"num_write_kb":114896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":186310656,"data_stored":250925056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":945,"ondisk_log_size":945,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":24,"seq":103079215123,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44164,"kb_used_data":12984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327676,"statfs":{"total":96636764160,"available":96591540224,"internally_reserved":0,"allocated":13295616,"data_stored":16780592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215120,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39016,"kb_used_data":7836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332824,"statfs":{"total":96636764160,"available":96596811776,"internally_reserved":0,"allocated":8024064,"data_stored":10046768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,7,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215120,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46464,"kb_used_data":15284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325376,"statfs":{"total":96636764160,"available":96589185024,"internally_reserved":0,"allocated":15650816,"data_stored":20729136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313232,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42828,"kb_used_data":15804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329012,"statfs":{"total":96636764160,"available":96592908288,"internally_reserved":0,"allocated":16183296,"data_stored":21833157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,4,6,7,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280528,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41840,"kb_used_data":10656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330000,"statfs":{"total":96636764160,"available":96593920000,"internally_reserved":0,"allocated":10911744,"data_stored":15115865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280529,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33528,"kb_used_data":6504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94338312,"statfs":{"total":96636764160,"available":96602431488,"internally_reserved":0,"allocated":6660096,"data_stored":8582597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,3,4,6,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280529,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45256,"kb_used_data":18232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94326584,"statfs":{"total":96636764160,"available":96590422016,"internally_reserved":0,"allocated":18669568,"data_stored":24095634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280527,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40872,"kb_used_data":13844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330968,"statfs":{"total":96636764160,"available":96594911232,"internally_reserved":0,"allocated":14176256,"data_stored":18396139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280529,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35936,"kb_used_data":8912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335904,"statfs":{"total":96636764160,"available":96599965696,"internally_reserved":0,"allocated":9125888,"data_stored":10181522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280527,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41904,"kb_used_data":14880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94329936,"statfs":{"total":96636764160,"available":96593854464,"internally_reserved":0,"allocated":15237120,"data_stored":18242450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,6,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280527,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38852,"kb_used_data":7668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94332988,"statfs":{"total":96636764160,"available":96596979712,"internally_reserved":0,"allocated":7852032,"data_stored":9010610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280528,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37472,"kb_used_data":10448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334368,"statfs":{"total":96636764160,"available":96598392832,"internally_reserved":0,"allocated":10698752,"data_stored":12340658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,7,8,9,10,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280527,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45160,"kb_used_data":13972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326680,"statfs":{"total":96636764160,"available":96590520320,"internally_reserved":0,"allocated":14307328,"data_stored":18150379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280528,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43984,"kb_used_data":16956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94327856,"statfs":{"total":96636764160,"available":96591724544,"internally_reserved":0,"allocated":17362944,"data_stored":23225323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,2,5,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280528,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35892,"kb_used_data":8868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335948,"statfs":{"total":96636764160,"available":96600010752,"internally_reserved":0,"allocated":9080832,"data_stored":9681810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215120,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49224,"kb_used_data":18040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322616,"statfs":{"total":96636764160,"available":96586358784,"internally_reserved":0,"allocated":18472960,"data_stored":24262085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17231872,"data_stored":23547904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":17477632,"data_stored":23412736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7933952,"data_stored":9498624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14942208,"data_stored":21118976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14426112,"data_stored":20525056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":6127616,"data_stored":7798784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9531392,"data_stored":11866112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13099008,"data_stored":17457152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":6799360,"data_stored":9842688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16154624,"data_stored":22532096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":9637888,"data_stored":14381056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":5419008,"data_stored":7868416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":12070912,"data_stored":16076800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":8445952,"data_stored":9736192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":12967936,"data_stored":17702912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":14045184,"data_stored":17559552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:24:56.732 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:56.731+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:56.794 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:56.794 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:56.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:24:56.810 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:56.810 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:56.831 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:56.831 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:56.835 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:24:56.831+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:24:56.848 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:56.849 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:56.869 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:56.869 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:56.887 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:56.888 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:56.908 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:56.908 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:56.928 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:56.929 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:56.933 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:56.934 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:56.934 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:56.934 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:56.936 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:56.933+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:56.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:24:56.950 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:56.950 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:56.965 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:56.966 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:56.985 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:56.986 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:57.003 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:57.004 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:57.024 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:57.024 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:57.037 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:57.033+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:57.043 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:57.043 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:57.064 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:57.064 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:57.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:57.063+0000 7f860bfff640 0 -- 172.21.15.59:0/3080980222 >> [v2:172.21.15.142:6809/4003882581,v1:172.21.15.142:6811/4003882581] conn(0x7f86142203a0 msgr2=0x7f8614222790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:57.074 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:57.074 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:57.074 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:57.074 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:57.074 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:57.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:24:57.139 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:24:57.135+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:24:57.214 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:57.214 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:57.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:57.214 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:57.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.214 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.214 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.292926832999996, 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.073984011000000002, 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.215 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918606+0000", 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.396e-06 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918620+0000", 2024-04-26T02:24:57.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:24:57.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918641+0000", 2024-04-26T02:24:57.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0389000000000001e-05 2024-04-26T02:24:57.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918657+0000", 2024-04-26T02:24:57.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6671999999999999e-05 2024-04-26T02:24:57.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918805+0000", 2024-04-26T02:24:57.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014724900000000001 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918819+0000", 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4453e-05 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.988816+0000", 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069997045999999993 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989070+0000", 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025383399999999998 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989371+0000", 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030080500000000002 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.990597+0000", 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012262740000000001 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992421+0000", 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001824132 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992517+0000", 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5880999999999999e-05 2024-04-26T02:24:57.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992587+0000", 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0359999999999997e-05 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.056323703999993, 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017497523000000001, 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 87 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155207+0000", 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3300000000000001e-07 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155289+0000", 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.1913e-05 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155300+0000", 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1202e-05 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155308+0000", 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7700000000000001e-06 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160230+0000", 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049217719999999996 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160358+0000", 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012813700000000001 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.160555+0000", 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197207 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163938+0000", 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003382945 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172543+0000", 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0086049179999999996 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172636+0000", 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2918999999999996e-05 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172704+0000", 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8007000000000001e-05 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.229 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 69.056209426999999, 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017505889, 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.230 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 88 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155322+0000", 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155328+0000", 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2700000000000001e-06 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155358+0000", 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0624999999999999e-05 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155373+0000", 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4229999999999999e-05 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.233 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.162973+0000", 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076001050000000002 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163128+0000", 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015489200000000001 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.234 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163377+0000", 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024957100000000003 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.165420+0000", 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020422349999999999 2024-04-26T02:24:57.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172717+0000", 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072976839999999996 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172781+0000", 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3910000000000003e-05 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.236 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172827+0000", 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5587000000000002e-05 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.884823331999996, 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018318649999999999, 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.237 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 114 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.238 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326708+0000", 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9700000000000005e-07 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.239 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326713+0000", 2024-04-26T02:24:57.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2024-04-26T02:24:57.240 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.240 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.240 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.240 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326722+0000", 2024-04-26T02:24:57.240 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9199999999999993e-06 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326729+0000", 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1489999999999997e-06 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.241 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339956+0000", 2024-04-26T02:24:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013227153 2024-04-26T02:24:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340087+0000", 2024-04-26T02:24:57.242 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130946 2024-04-26T02:24:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340294+0000", 2024-04-26T02:24:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206434 2024-04-26T02:24:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.243 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344052+0000", 2024-04-26T02:24:57.244 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037581490000000001 2024-04-26T02:24:57.244 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.244 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.244 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.244 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344900+0000", 2024-04-26T02:24:57.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084779500000000004 2024-04-26T02:24:57.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.245 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.245 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.245 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344967+0000", 2024-04-26T02:24:57.245 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607000000000005e-05 2024-04-26T02:24:57.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345026+0000", 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8146999999999997e-05 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.246 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.884790449999997, 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019222108000000002, 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 115 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.247 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0399999999999995e-07 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326874+0000", 2024-04-26T02:24:57.248 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013342599999999999 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326885+0000", 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1323e-05 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326893+0000", 2024-04-26T02:24:57.249 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7659999999999998e-06 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342112+0000", 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015218537000000001 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.250 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342342+0000", 2024-04-26T02:24:57.254 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023057199999999999 2024-04-26T02:24:57.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.254 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.255 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.255 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342691+0000", 2024-04-26T02:24:57.255 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034918900000000002 2024-04-26T02:24:57.255 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.255 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345831+0000", 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031394740000000002 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345848+0000", 2024-04-26T02:24:57.256 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7686e-05 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345912+0000", 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3709999999999998e-05 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345962+0000", 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9721e-05 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.257 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.884619779000005, 2024-04-26T02:24:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019714167000000001, 2024-04-26T02:24:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.258 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.259 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 116 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:57.260 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326911+0000", 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.261 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326924+0000", 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2743e-05 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326934+0000", 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5459999999999997e-06 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326941+0000", 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1470000000000004e-06 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.262 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344124+0000", 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017183085000000001 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344238+0000", 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114591 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344425+0000", 2024-04-26T02:24:57.263 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018710800000000001 2024-04-26T02:24:57.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.264 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.264 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345974+0000", 2024-04-26T02:24:57.264 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001548979 2024-04-26T02:24:57.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.264 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.265 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.265 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346498+0000", 2024-04-26T02:24:57.265 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052335399999999996 2024-04-26T02:24:57.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.266 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.266 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346570+0000", 2024-04-26T02:24:57.266 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1983000000000005e-05 2024-04-26T02:24:57.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.266 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346625+0000", 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4843999999999999e-05 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.267 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.884577786999998, 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020133699000000001, 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.268 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.269 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 117 2024-04-26T02:24:57.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.269 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.269 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.269 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:57.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:24:57.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326953+0000", 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326959+0000", 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.823e-06 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326968+0000", 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9530000000000005e-06 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326979+0000", 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1289e-05 2024-04-26T02:24:57.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345091+0000", 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018111505999999999 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345217+0000", 2024-04-26T02:24:57.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012587399999999999 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345409+0000", 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019226700000000001 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346352+0000", 2024-04-26T02:24:57.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00094280000000000004 2024-04-26T02:24:57.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346964+0000", 2024-04-26T02:24:57.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061192899999999999 2024-04-26T02:24:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347036+0000", 2024-04-26T02:24:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2120999999999996e-05 2024-04-26T02:24:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347086+0000", 2024-04-26T02:24:57.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0377000000000002e-05 2024-04-26T02:24:57.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.277 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.277 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.719853099999995, 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018319485, 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.278 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 139 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491678+0000", 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.333e-06 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491688+0000", 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9299999999999998e-06 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491707+0000", 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8281999999999999e-05 2024-04-26T02:24:57.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491720+0000", 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3502e-05 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504966+0000", 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013245808 2024-04-26T02:24:57.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505190+0000", 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000223876 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505520+0000", 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032999 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508527+0000", 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030072739999999999 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509751+0000", 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012241719999999999 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509880+0000", 2024-04-26T02:24:57.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128687 2024-04-26T02:24:57.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509997+0000", 2024-04-26T02:24:57.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116631 2024-04-26T02:24:57.286 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.287 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.287 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.287 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.287 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:57.287 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.719789923999997, 2024-04-26T02:24:57.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018559454, 2024-04-26T02:24:57.288 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.288 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.288 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.288 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.288 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.289 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.289 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 140 2024-04-26T02:24:57.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.289 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.290 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491742+0000", 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.404e-06 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491946+0000", 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204086 2024-04-26T02:24:57.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491967+0000", 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1049000000000001e-05 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491983+0000", 2024-04-26T02:24:57.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6356000000000001e-05 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507052+0000", 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015069173 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507208+0000", 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000155783 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507411+0000", 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020306 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510024+0000", 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026129 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510123+0000", 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8667999999999998e-05 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510230+0000", 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107565 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510300+0000", 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9410000000000001e-05 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.719518899999997, 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018767703, 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 141 2024-04-26T02:24:57.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492013+0000", 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492039+0000", 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5952000000000002e-05 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492058+0000", 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9215000000000002e-05 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492082+0000", 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4379000000000002e-05 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508623+0000", 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016540947 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508846+0000", 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022293599999999999 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509201+0000", 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035443900000000001 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510580+0000", 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013797379999999999 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510627+0000", 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6254000000000001e-05 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510715+0000", 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8215999999999997e-05 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510779+0000", 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4136999999999999e-05 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:57.301 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.408666968999995, 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018162602999999999, 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 186 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:57.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802865+0000", 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.666e-06 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802876+0000", 2024-04-26T02:24:57.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1246e-05 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802898+0000", 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1645999999999999e-05 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802923+0000", 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5389e-05 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.815977+0000", 2024-04-26T02:24:57.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013053301 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816115+0000", 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138553 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816319+0000", 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204236 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820746+0000", 2024-04-26T02:24:57.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044270739999999996 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820868+0000", 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122127 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820949+0000", 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0395999999999994e-05 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821026+0000", 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6969000000000001e-05 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.40858154, 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018225614000000001, 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.307 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 187 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802950+0000", 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802963+0000", 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3206e-05 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802982+0000", 2024-04-26T02:24:57.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8519e-05 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803002+0000", 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0162000000000001e-05 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816937+0000", 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013934867 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817068+0000", 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130734 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817285+0000", 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000217209 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820849+0000", 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035643160000000001 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821038+0000", 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000188767 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821122+0000", 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4243e-05 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821174+0000", 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2181000000000001e-05 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.408485318000004, 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018460061999999999, 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 188 2024-04-26T02:24:57.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803046+0000", 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4500000000000001e-06 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803180+0000", 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013367300000000001 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803201+0000", 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1399e-05 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803217+0000", 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5556000000000001e-05 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818151+0000", 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014934374 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818319+0000", 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016765500000000001 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818541+0000", 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022229899999999999 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821196+0000", 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002654965 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821379+0000", 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018284400000000001 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821453+0000", 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3546000000000004e-05 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821505+0000", 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2301e-05 2024-04-26T02:24:57.318 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.408285432, 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018840794000000001, 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:24:57.319 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803246+0000", 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803257+0000", 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0825999999999999e-05 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803275+0000", 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8099999999999999e-05 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803288+0000", 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2595999999999999e-05 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819675+0000", 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016387184999999999 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819800+0000", 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012490999999999999 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820077+0000", 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000277533 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821271+0000", 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193401 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821965+0000", 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069420199999999999 2024-04-26T02:24:57.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822036+0000", 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1119999999999997e-05 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822086+0000", 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9400999999999997e-05 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:327 3.8s0 3:1859e9b5:::smithi17529564-39:head [create,setxattr `sjUtrS\\bejkdS^PZ^UbhfeR]sl^p__anSUR_aom (1578) in=40b,setxattr Xgg (981) in=3b,setxattr jjU_`S[ao\\\\^aUS`bZo^cefhdeaegSZfc]sS[m[k (631) in=40b,setxattr WptVXs^]ZljihqWVjRTTRsYbpoOd[kede^[d^iNS (15648) in=40b,setxattr NUPa_VdcRWiTY (981) in=13b,setxattr oapqrhbaXndiek^ec[NZPnlNjeX^`^^ht`__ll[g (630) in=40b,setxattr hUokalb_dNqZaP[SZdSptRb]ZndqQTkPSdWpXlg_ (1683) in=40b,setxattr SOaUaOtoOmejUfsqfadVc_\\fpWak\\^nknRQfaXOZ (9120) in=40b,setxattr r[RO_Pl (981) in=7b,setxattr OOd^ZXYi[]NO^mlSkQafkPlVaY`UYcd\\bnaQUZjq (1225) in=40b,setxattr mlY]_qqgYNhaYetZtkgQPN^a^VmW[amS`Qbadgjr (137) in=40b,setxattr iVYdjchT[j\\[\\\\Uto`qnjUcXas^PtqZa^VoRktTT (1823) in=40b,setxattr PhV`]ZkggalnUas (981) in=15b,setxattr [TNbUtYOkT`ZatPerOQOlk\\WahmgadNWaeRZ^YT\\ (1121) in=40b,setxattr aRqq]f]b_cobaZ`ZZRaattjja[X``PaT\\l\\^Y[jU (313) in=40b,setxattr qYXjVRWg (981) in=8b,setxattr cm`nfp^lmRcSZUsStaOg_omiONqeTRWUsOjm]png (1227) in=40b,setxattr _jtbmRhQeZe]nY\\TQctPVagWm[isibp]ooW`hq[Z (1367) in=40b,setxattr _Ybhal\\]RPkmpUPPRRb[_[YfQpj[aXsgkfNbeeOZ (946) in=40b,setxattr YeQo_aSrmVSirmpTkkZqfZaaqOtg\\X\\qoRPrjPai (1786) in=40b] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 41.725927867999999, 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019121231999999998, 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 327 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485606+0000", 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9339999999999999e-06 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485768+0000", 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162189 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485811+0000", 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2292000000000001e-05 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485835+0000", 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4182999999999999e-05 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485963+0000", 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128157 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485976+0000", 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2571999999999999e-05 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490733+0000", 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047575610000000004 2024-04-26T02:24:57.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491054+0000", 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032119599999999999 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493981+0000", 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002926484 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503531+0000", 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009550088 2024-04-26T02:24:57.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503808+0000", 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027720000000000002 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.504724+0000", 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091537599999999997 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.330 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:364 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.749495379999999, 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019186933, 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 364 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462038+0000", 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6800000000000002e-06 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462048+0000", 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0835999999999999e-05 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462072+0000", 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3693000000000002e-05 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462089+0000", 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6586e-05 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462283+0000", 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000194496 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462306+0000", 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2476e-05 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471461+0000", 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091555809999999994 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471729+0000", 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026759800000000002 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.481222+0000", 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094929869999999996 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.335 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:365 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.749408774999999, 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021296017, 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 365 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462123+0000", 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.39e-06 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462153+0000", 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9685000000000001e-05 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462165+0000", 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2964e-05 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462181+0000", 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5778999999999999e-05 2024-04-26T02:24:57.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462501+0000", 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031995299999999999 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462521+0000", 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9715999999999999e-05 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473587+0000", 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01106558 2024-04-26T02:24:57.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473802+0000", 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215899 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.483417+0000", 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096150509999999995 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:366 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 34.749310194000003, 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022939240999999999, 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 366 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462221+0000", 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462229+0000", 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4560000000000003e-06 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462246+0000", 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7116e-05 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462259+0000", 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3526999999999999e-05 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462633+0000", 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037355199999999998 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462652+0000", 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9165999999999999e-05 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478081+0000", 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015429238 2024-04-26T02:24:57.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478329+0000", 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024798499999999999 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.485159+0000", 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068299909999999997 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.345 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:508 3.8s0 3:1cc02c30:::smithi17529564-2:head [append 0~606208] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.739125625, 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018229054000000001, 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 508 2024-04-26T02:24:57.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472408+0000", 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0800000000000002e-06 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473853+0000", 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014451850000000001 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473888+0000", 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4891999999999997e-05 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473913+0000", 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5123e-05 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474093+0000", 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018053700000000001 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474110+0000", 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6540000000000001e-05 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.349 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479082+0000", 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049724280000000001 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479346+0000", 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026396500000000001 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.482004+0000", 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026579569999999999 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.489855+0000", 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078503649999999998 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490489+0000", 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063439499999999995 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490634+0000", 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144587 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.351 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:512 3.8s0 3:1cc02c30:::smithi17529564-2:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 29.725970011000001, 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017479077999999999, 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 512 2024-04-26T02:24:57.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485560+0000", 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485562+0000", 2024-04-26T02:24:57.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3e-06 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485569+0000", 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3830000000000003e-06 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485622+0000", 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3565e-05 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.485640+0000", 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7416999999999999e-05 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.497174+0000", 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011534342 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.497333+0000", 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015877 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.500226+0000", 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002893446 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.500351+0000", 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012475499999999999 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.503039+0000", 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026881000000000001 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.357 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:57.358 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:57.359 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:57.359 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:24:57.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:24:57.360 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:57.355+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:57.361 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:24:57.459 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:57.455+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-04-26T02:24:57.478 INFO:tasks.rados.rados.0.smithi175.stdout:296: done (1 left) 2024-04-26T02:24:57.478 INFO:tasks.rados.rados.0.smithi175.stdout:297: setattr oid 34 current snap is 31 2024-04-26T02:24:57.478 INFO:tasks.rados.rados.0.smithi175.stdout:295: finishing rollback tid 1 to smithi17529564-30 2024-04-26T02:24:57.478 INFO:tasks.rados.rados.0.smithi175.stdout:295: finishing rollback tid 2 to smithi17529564-30 2024-04-26T02:24:57.478 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 97 (ObjNum 104 snap 13 seq_num 104) dirty exists 2024-04-26T02:24:57.481 INFO:tasks.rados.rados.0.smithi175.stdout:295: done (1 left) 2024-04-26T02:24:57.481 INFO:tasks.rados.rados.0.smithi175.stdout:298: rollback oid 41 current snap is 31 2024-04-26T02:24:57.481 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 41 to 24 2024-04-26T02:24:57.481 INFO:tasks.rados.rados.0.smithi175.stdout:299: delete oid 13 current snap is 31 2024-04-26T02:24:57.500 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 34 v 154 (ObjNum 86 snap 12 seq_num 86) dirty exists 2024-04-26T02:24:57.502 INFO:tasks.rados.rados.0.smithi175.stdout:298: finishing rollback tid 0 to smithi17529564-41 2024-04-26T02:24:57.502 INFO:tasks.rados.rados.0.smithi175.stdout:298: finishing rollback tid 1 to smithi17529564-41 2024-04-26T02:24:57.502 INFO:tasks.rados.rados.0.smithi175.stdout:298: finishing rollback tid 2 to smithi17529564-41 2024-04-26T02:24:57.502 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 41 v 158 (ObjNum 111 snap 16 seq_num 111) dirty exists 2024-04-26T02:24:57.503 INFO:tasks.rados.rados.0.smithi175.stdout:297: done (2 left) 2024-04-26T02:24:57.503 INFO:tasks.rados.rados.0.smithi175.stdout:298: done (1 left) 2024-04-26T02:24:57.503 INFO:tasks.rados.rados.0.smithi175.stdout:299: done (0 left) 2024-04-26T02:24:57.503 INFO:tasks.rados.rados.0.smithi175.stdout:300: setattr oid 44 current snap is 31 2024-04-26T02:24:57.507 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 21 current snap is 31 2024-04-26T02:24:57.507 INFO:tasks.rados.rados.0.smithi175.stdout:301: seq_num 135 ranges {1212416=720896,1933312=622592,2555904=688128,3244032=245760} 2024-04-26T02:24:57.539 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:57.539 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:57.539 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:57.539 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:57.540 INFO:tasks.rados.rados.0.smithi175.stdout:301: writing smithi17529564-21 from 1212416 to 1933312 tid 1 2024-04-26T02:24:57.550 INFO:tasks.rados.rados.0.smithi175.stdout:301: writing smithi17529564-21 from 1933312 to 2555904 tid 2 2024-04-26T02:24:57.557 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:24:57.559 INFO:tasks.rados.rados.0.smithi175.stdout:301: writing smithi17529564-21 from 2555904 to 3244032 tid 3 2024-04-26T02:24:57.560 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:57.557+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:57.562 INFO:tasks.rados.rados.0.smithi175.stdout:301: writing smithi17529564-21 from 3244032 to 3489792 tid 4 2024-04-26T02:24:57.563 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 31 current snap is 31 2024-04-26T02:24:57.563 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 44 v 70 (ObjNum 101 snap 13 seq_num 101) dirty exists 2024-04-26T02:24:57.563 INFO:tasks.rados.rados.0.smithi175.stdout:301: finishing write tid 1 to smithi17529564-21 2024-04-26T02:24:57.563 INFO:tasks.rados.rados.0.smithi175.stdout:301: finishing write tid 2 to smithi17529564-21 2024-04-26T02:24:57.563 INFO:tasks.rados.rados.0.smithi175.stdout:302: seq_num 136 ranges {2850816=737280,3588096=770048,4358144=540672,4898816=245760} 2024-04-26T02:24:57.599 INFO:tasks.rados.rados.0.smithi175.stdout:302: writing smithi17529564-31 from 2850816 to 3588096 tid 1 2024-04-26T02:24:57.606 INFO:tasks.rados.rados.0.smithi175.stdout:302: writing smithi17529564-31 from 3588096 to 4358144 tid 2 2024-04-26T02:24:57.610 INFO:tasks.rados.rados.0.smithi175.stdout:302: writing smithi17529564-31 from 4358144 to 4898816 tid 3 2024-04-26T02:24:57.613 INFO:tasks.rados.rados.0.smithi175.stdout:302: writing smithi17529564-31 from 4898816 to 5144576 tid 4 2024-04-26T02:24:57.613 INFO:tasks.rados.rados.0.smithi175.stdout:300: done (2 left) 2024-04-26T02:24:57.613 INFO:tasks.rados.rados.0.smithi175.stdout:303: snap_create 2024-04-26T02:24:57.613 INFO:tasks.rados.rados.0.smithi175.stdout:301: finishing write tid 3 to smithi17529564-21 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: finishing write tid 4 to smithi17529564-21 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: finishing write tid 5 to smithi17529564-21 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: finishing write tid 6 to smithi17529564-21 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: oid 21 updating version 0 to 67 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: oid 21 version 67 is already newer than 66 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: oid 21 version 67 is already newer than 64 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: oid 21 version 67 is already newer than 65 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: oid 21 updating version 67 to 68 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 21 v 68 (ObjNum 135 snap 31 seq_num 135) dirty exists 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:301: left oid 21 (ObjNum 135 snap 31 seq_num 135) 2024-04-26T02:24:57.614 INFO:tasks.rados.rados.0.smithi175.stdout:302: finishing write tid 1 to smithi17529564-31 2024-04-26T02:24:57.617 INFO:tasks.rados.rados.0.smithi175.stdout:302: finishing write tid 2 to smithi17529564-31 2024-04-26T02:24:57.620 INFO:tasks.rados.rados.0.smithi175.stdout:302: finishing write tid 3 to smithi17529564-31 2024-04-26T02:24:57.623 INFO:tasks.rados.rados.0.smithi175.stdout:302: finishing write tid 4 to smithi17529564-31 2024-04-26T02:24:57.624 INFO:tasks.rados.rados.0.smithi175.stdout:302: finishing write tid 5 to smithi17529564-31 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:302: finishing write tid 6 to smithi17529564-31 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:302: oid 31 updating version 0 to 73 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:302: oid 31 version 73 is already newer than 72 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:302: oid 31 updating version 73 to 74 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:302: oid 31 updating version 74 to 76 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:302: oid 31 version 76 is already newer than 75 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 31 v 76 (ObjNum 136 snap 31 seq_num 136) dirty exists 2024-04-26T02:24:57.628 INFO:tasks.rados.rados.0.smithi175.stdout:302: left oid 31 (ObjNum 136 snap 31 seq_num 136) 2024-04-26T02:24:57.664 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:57.657+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:57.726 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:57.726 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:57.726 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:57.726 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:57.726 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:57.739 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:24:57.765 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:57.759+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.823541720000001, 2024-04-26T02:24:57.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082822989999999999, 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039355+0000", 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3300000000000001e-07 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039418+0000", 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2694999999999995e-05 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039447+0000", 2024-04-26T02:24:57.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9442e-05 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039470+0000", 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039659+0000", 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018914299999999999 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039683+0000", 2024-04-26T02:24:57.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3915999999999999e-05 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047533+0000", 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078494710000000002 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047636+0000", 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103566 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 51.821366169000001, 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011160114, 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4000000000000002e-07 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041580+0000", 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9351999999999998e-05 2024-04-26T02:24:57.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041619+0000", 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9152000000000001e-05 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041643+0000", 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.421e-05 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041841+0000", 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197784 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041867+0000", 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5939e-05 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052596+0000", 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01072906 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052690+0000", 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4077000000000001e-05 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.876 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 35.003427197999997, 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083055990000000003, 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:57.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8700000000000001e-07 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862768+0000", 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003299438 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862799+0000", 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0465999999999999e-05 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862815+0000", 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6118999999999999e-05 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862957+0000", 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014188100000000001 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862972+0000", 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5512999999999999e-05 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867700+0000", 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00472735 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867774+0000", 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4444999999999996e-05 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs2 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.301510817, 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093447500000000006, 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.882 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561386+0000", 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8999999999999996e-07 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561441+0000", 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5689000000000002e-05 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561502+0000", 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0788000000000001e-05 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561527+0000", 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4479999999999999e-05 2024-04-26T02:24:57.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561735+0000", 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020879899999999999 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561760+0000", 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5003000000000001e-05 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570592+0000", 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088311770000000008 2024-04-26T02:24:57.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570730+0000", 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138224 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.29684151, 2024-04-26T02:24:57.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013994609999999999, 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566055+0000", 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566133+0000", 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7651999999999994e-05 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566166+0000", 2024-04-26T02:24:57.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3189999999999999e-05 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566189+0000", 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3315e-05 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566604+0000", 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041534500000000002 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566631+0000", 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6792999999999999e-05 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579960+0000", 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013328751 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580049+0000", 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8918000000000005e-05 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.294768340000001, 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015943736999999999, 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568128+0000", 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3e-07 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568181+0000", 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2899000000000003e-05 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568212+0000", 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0596000000000003e-05 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568238+0000", 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6169999999999998e-05 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568483+0000", 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000245121 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568508+0000", 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5593e-05 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.583979+0000", 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015470133 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584071+0000", 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2595000000000004e-05 2024-04-26T02:24:57.894 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.292123575000002, 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013783561999999999, 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570774+0000", 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6029999999999999e-06 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570834+0000", 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0248999999999999e-05 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570863+0000", 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8473e-05 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570927+0000", 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4335e-05 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571242+0000", 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000315144 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571308+0000", 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5808000000000004e-05 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584459+0000", 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013150818 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584556+0000", 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7132000000000004e-05 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.288841476000002, 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011186935, 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.899 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574055+0000", 2024-04-26T02:24:57.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574110+0000", 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4701999999999999e-05 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574134+0000", 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4672999999999999e-05 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574153+0000", 2024-04-26T02:24:57.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8372999999999998e-05 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576753+0000", 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026005830000000001 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576778+0000", 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4793000000000001e-05 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585168+0000", 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083896360000000007 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585241+0000", 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3515000000000003e-05 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:24:57.903 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.287149117999999, 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084735320000000006, 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575749+0000", 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8700000000000001e-06 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575775+0000", 2024-04-26T02:24:57.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6783000000000001e-05 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575804+0000", 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8296000000000001e-05 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575826+0000", 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1970000000000001e-05 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576058+0000", 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023252799999999999 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576084+0000", 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5469e-05 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584119+0000", 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080353009999999999 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584220+0000", 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101315 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:24:57.910 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.284036135000001, 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010250464000000001, 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:24:57.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578862+0000", 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.136e-06 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578953+0000", 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1671999999999999e-05 2024-04-26T02:24:57.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578986+0000", 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2431999999999997e-05 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579009+0000", 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2997e-05 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580832+0000", 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018229279999999999 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580857+0000", 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5069999999999999e-05 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589005+0000", 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081481079999999994 2024-04-26T02:24:57.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589110+0000", 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105121 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 70/31 ECSubWrite(tid=55, reqid=client.4589.0:560, at_version=70'42, trim_to=0'0, roll_forward_to=66'40))", 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.297647899000001, 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093224269999999995, 2024-04-26T02:24:57.915 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565250+0000", 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6199999999999999e-06 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565896+0000", 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064622300000000002 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565930+0000", 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4175999999999999e-05 2024-04-26T02:24:57.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565946+0000", 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6552999999999999e-05 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566110+0000", 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000163468 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566143+0000", 2024-04-26T02:24:57.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2833000000000002e-05 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574369+0000", 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082260839999999998 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574570+0000", 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020147000000000001 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 70/31 ECSubWrite(tid=94, reqid=client.4589.0:568, at_version=70'45, trim_to=0'0, roll_forward_to=66'44))", 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.272928807, 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008202048, 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589975+0000", 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3129999999999999e-06 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590472+0000", 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00049691600000000002 2024-04-26T02:24:57.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590505+0000", 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2285e-05 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590526+0000", 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1923999999999999e-05 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590669+0000", 2024-04-26T02:24:57.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014244400000000001 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590693+0000", 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4459000000000001e-05 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598075+0000", 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073818080000000001 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598169+0000", 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3899000000000003e-05 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3848113990000002, 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082988119999999992, 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.924 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478086+0000", 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.734e-06 2024-04-26T02:24:57.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478493+0000", 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040724799999999997 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478528+0000", 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4873000000000003e-05 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478550+0000", 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2056e-05 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478704+0000", 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015417299999999999 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478732+0000", 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7063000000000002e-05 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486268+0000", 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075361270000000001 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486383+0000", 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115538 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.483691+0000", 2024-04-26T02:24:57.928 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3792051010000002, 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081778570000000002, 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483691+0000", 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483691+0000", 2024-04-26T02:24:57.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483693+0000", 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3259999999999998e-06 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483748+0000", 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5232999999999998e-05 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483782+0000", 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3964999999999998e-05 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483805+0000", 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2359999999999999e-05 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485215+0000", 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001410761 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485241+0000", 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6143e-05 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491774+0000", 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065329079999999996 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491869+0000", 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4160999999999995e-05 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.932 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=143, reqid=osd.13.0:143, at_version=85'52, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3746568119999996, 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011977942, 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:24:57.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488240+0000", 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0999999999999999e-07 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488293+0000", 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3179e-05 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488325+0000", 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2786000000000001e-05 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488348+0000", 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2572999999999999e-05 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488541+0000", 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019315599999999999 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488567+0000", 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5746e-05 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500120+0000", 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011552644000000001 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500217+0000", 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7348000000000004e-05 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s5 85/31 ECSubWrite(tid=44, reqid=osd.3.0:44, at_version=85'40, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.489090+0000", 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3738055429999996, 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080004470000000008, 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.937 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489090+0000", 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489090+0000", 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489092+0000", 2024-04-26T02:24:57.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.68e-06 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489142+0000", 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0185000000000001e-05 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489172+0000", 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9709999999999998e-05 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489198+0000", 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6308999999999998e-05 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489453+0000", 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025496200000000002 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489479+0000", 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6049000000000001e-05 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496999+0000", 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075202309999999996 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.497091+0000", 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1321000000000002e-05 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s5 85/31 ECSubWrite(tid=45, reqid=osd.3.0:45, at_version=85'42, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:24:57.941 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3709307329999998, 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093409329999999992, 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491967+0000", 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492019+0000", 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2326e-05 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492059+0000", 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0499e-05 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492088+0000", 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8883000000000001e-05 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493095+0000", 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010064850000000001 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.944 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493119+0000", 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3900000000000002e-05 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501188+0000", 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080696529999999995 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501306+0000", 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011764699999999999 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.945 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 85/31 ECSubWrite(tid=259, reqid=osd.6.0:259, at_version=85'86, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3707834659999998, 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091845999999999994, 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492113+0000", 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1399999999999997e-07 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492162+0000", 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9152e-05 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492192+0000", 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9983000000000001e-05 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492215+0000", 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3206000000000001e-05 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492386+0000", 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000170466 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5225999999999999e-05 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501191+0000", 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087800949999999999 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501297+0000", 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105858 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 85/31 ECSubWrite(tid=57, reqid=osd.14.0:57, at_version=85'56, trim_to=0'0, roll_forward_to=82'54))", 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.370520891, 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088827960000000001, 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.950 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492376+0000", 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1600000000000001e-07 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492431+0000", 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5229000000000003e-05 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492463+0000", 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2716000000000003e-05 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.952 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492487+0000", 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3050000000000001e-05 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492914+0000", 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042767800000000002 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492946+0000", 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1772e-05 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501157+0000", 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082111800000000002 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501258+0000", 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100555 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.954 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=144, reqid=osd.13.0:144, at_version=85'54, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.3667480659999995, 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083376070000000004, 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:57.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496155+0000", 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5669999999999997e-06 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496209+0000", 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3538999999999997e-05 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496244+0000", 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4665000000000001e-05 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496267+0000", 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3533e-05 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496416+0000", 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014877400000000001 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496443+0000", 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7146000000000001e-05 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504421+0000", 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079782480000000003 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504485+0000", 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4134999999999995e-05 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.958 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.959 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.959 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:57.959 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:57.959 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:57.959 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:24:57.863+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:24:57.960 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:24:57.974 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:24:57.967+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:24:58.073 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:58.071+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:58.088 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:58.088 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:24:58.088 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:58.103 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_blocked_ops 2024-04-26T02:24:58.173 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:24:58.167+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:24:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:24:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:24:58.227 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:24:58.227 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:58.241 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_historic_ops 2024-04-26T02:24:58.276 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:58.271+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:58.381 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:24:58.371+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:24:58.410 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s1 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.559175+0000", 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.847529568999999, 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011413924000000001, 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.411 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559175+0000", 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559175+0000", 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559176+0000", 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5430000000000001e-06 2024-04-26T02:24:58.412 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559224+0000", 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7655999999999999e-05 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559246+0000", 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2382999999999999e-05 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559262+0000", 2024-04-26T02:24:58.413 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.526e-05 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561563+0000", 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0023016949999999999 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.414 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561601+0000", 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7302999999999998e-05 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570496+0000", 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088953690000000002 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570589+0000", 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2714999999999996e-05 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.415 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567325+0000", 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.839379507, 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012833327, 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567325+0000", 2024-04-26T02:24:58.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567325+0000", 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567327+0000", 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.903e-06 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567378+0000", 2024-04-26T02:24:58.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0754999999999998e-05 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567405+0000", 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7440000000000002e-05 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567427+0000", 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2013000000000001e-05 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570487+0000", 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003060236 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570513+0000", 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5503e-05 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580062+0000", 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0095491359999999997 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580158+0000", 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6341000000000005e-05 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:591 3.2s0 3:4ada42ed:::smithi17529564-22:head [rollback 13] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:38.486316+0000", 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.920388275000001, 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011841552, 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:58.420 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 591 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486316+0000", 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486316+0000", 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.421 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486317+0000", 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.06e-06 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486323+0000", 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2199999999999997e-06 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486355+0000", 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1863000000000003e-05 2024-04-26T02:24:58.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486370+0000", 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4333e-05 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.489701+0000", 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0033316040000000002 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.489955+0000", 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025324599999999999 2024-04-26T02:24:58.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.491476+0000", 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001521445 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.495852+0000", 2024-04-26T02:24:58.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0043765059999999996 2024-04-26T02:24:58.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:58.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498008+0000", 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0021557640000000001 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498158+0000", 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014951100000000001 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:592 3.2s0 3:4ada42ed:::smithi17529564-22:head [append 0~0] snapc 17=[17,15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-26T02:24:58.426 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:38.486393+0000", 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 19.920311388999998, 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012224664999999999, 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 592 2024-04-26T02:24:58.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486393+0000", 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486393+0000", 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486394+0000", 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9999999999999996e-07 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486398+0000", 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1169999999999997e-06 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486411+0000", 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3098999999999999e-05 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.486425+0000", 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.377e-05 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.492673+0000", 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006248399 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.492912+0000", 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000238349 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.493844+0000", 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00093213400000000004 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.496260+0000", 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0024164830000000001 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498523+0000", 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0022631190000000001 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.431 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:38.498618+0000", 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4295000000000004e-05 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:630 3.2s0 3:492e5739:::smithi17529564-20:13 [read 0~0,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:42.471942+0000", 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.934762291, 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016446002000000001, 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:58.432 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 630 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.471942+0000", 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.471942+0000", 2024-04-26T02:24:58.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.471945+0000", 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7039999999999999e-06 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.471958+0000", 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2670000000000001e-05 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.471984+0000", 2024-04-26T02:24:58.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6838999999999998e-05 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472004+0000", 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9298999999999999e-05 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.481918+0000", 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0099147690000000004 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.482253+0000", 2024-04-26T02:24:58.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000334648 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.487700+0000", 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054470839999999996 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.487963+0000", 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000262873 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.488388+0000", 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042511600000000001 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:631 3.2s0 3:492e5739:::smithi17529564-20:13 [read 0~0,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:42.472042+0000", 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.934662693, 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017037238999999999, 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:58.437 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 631 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472042+0000", 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472042+0000", 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472043+0000", 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.33e-06 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472051+0000", 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3129999999999999e-06 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472071+0000", 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9660000000000002e-05 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472134+0000", 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2990999999999994e-05 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.482748+0000", 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0106137 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:58.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.482982+0000", 2024-04-26T02:24:58.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023467400000000001 2024-04-26T02:24:58.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.488512+0000", 2024-04-26T02:24:58.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055295730000000003 2024-04-26T02:24:58.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.488770+0000", 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000258063 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.489079+0000", 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030893499999999998 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:632 3.2s0 3:492e5739:::smithi17529564-20:13 [read 0~0,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75)", 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:42.472160+0000", 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.934544166, 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019090592999999999, 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.444 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 632 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472160+0000", 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472160+0000", 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472162+0000", 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.516e-06 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472173+0000", 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0723000000000001e-05 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472228+0000", 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5795999999999999e-05 2024-04-26T02:24:58.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.472263+0000", 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4306e-05 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.483148+0000", 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01088564 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.483319+0000", 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017106900000000001 2024-04-26T02:24:58.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.489382+0000", 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060625940000000001 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.490935+0000", 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001552884 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:42.491251+0000", 2024-04-26T02:24:58.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031606499999999998 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs3 85/31 ECSubWrite(tid=266, reqid=osd.0.0:266, at_version=85'68, trim_to=0'0, roll_forward_to=84'66))", 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.484113+0000", 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9225917450000001, 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022158361000000001, 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484113+0000", 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484113+0000", 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484113+0000", 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.8999999999999997e-07 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484167+0000", 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3495999999999997e-05 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484203+0000", 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6253e-05 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484224+0000", 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1426000000000001e-05 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484436+0000", 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00021167899999999999 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484461+0000", 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4885999999999999e-05 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.506184+0000", 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021723070000000001 2024-04-26T02:24:58.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.506271+0000", 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7060999999999999e-05 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s2 85/31 ECSubWrite(tid=77, reqid=osd.11.0:77, at_version=85'63, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.484563+0000", 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9221415239999997, 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017768308999999999, 2024-04-26T02:24:58.453 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484563+0000", 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484563+0000", 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484564+0000", 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8699999999999995e-07 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484615+0000", 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1579000000000002e-05 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484646+0000", 2024-04-26T02:24:58.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0479000000000001e-05 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484672+0000", 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6463000000000001e-05 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484838+0000", 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016552 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484862+0000", 2024-04-26T02:24:58.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4545999999999998e-05 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502228+0000", 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017365776999999999 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502331+0000", 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103358 2024-04-26T02:24:58.457 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s2 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.484721+0000", 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9219837430000002, 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.027600471000000001, 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484721+0000", 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484721+0000", 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484721+0000", 2024-04-26T02:24:58.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8599999999999997e-07 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484785+0000", 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3497999999999994e-05 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484835+0000", 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0408999999999998e-05 2024-04-26T02:24:58.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.484854+0000", 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8819999999999999e-05 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491252+0000", 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006397631 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491278+0000", 2024-04-26T02:24:58.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5999999999999998e-05 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512191+0000", 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020913627000000001 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512321+0000", 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012970000000000001 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.es1 85/31 ECSubWrite(tid=142, reqid=osd.13.0:142, at_version=85'67, trim_to=0'0, roll_forward_to=83'63))", 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.485339+0000", 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9213650659999999, 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020568026999999999, 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485339+0000", 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485339+0000", 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485341+0000", 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.736e-06 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485409+0000", 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7441999999999996e-05 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486866+0000", 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014572560000000001 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486889+0000", 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.355e-05 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489444+0000", 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025542009999999999 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489468+0000", 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4318999999999999e-05 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.505813+0000", 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016345188 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.505907+0000", 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4334999999999997e-05 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.466 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 85/31 ECSubWrite(tid=44, reqid=osd.3.0:44, at_version=85'40, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.488946+0000", 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.917758901, 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.023402466, 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488946+0000", 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488946+0000", 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488946+0000", 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8599999999999998e-07 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.468 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489018+0000", 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2195999999999998e-05 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489045+0000", 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6712000000000001e-05 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489066+0000", 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0684000000000001e-05 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.497151+0000", 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080850720000000004 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.497176+0000", 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4873000000000001e-05 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512296+0000", 2024-04-26T02:24:58.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015119881999999999 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512348+0000", 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2460999999999998e-05 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s4 85/31 ECSubWrite(tid=45, reqid=osd.3.0:45, at_version=85'42, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.491953+0000", 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9147516229999999, 2024-04-26T02:24:58.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021373458000000001, 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491953+0000", 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491953+0000", 2024-04-26T02:24:58.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491955+0000", 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.79e-06 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492004+0000", 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9325e-05 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492036+0000", 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2246000000000003e-05 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492058+0000", 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1886999999999999e-05 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.503511+0000", 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011452538999999999 2024-04-26T02:24:58.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.503538+0000", 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7118999999999999e-05 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.513264+0000", 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0097266160000000004 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.513326+0000", 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1935999999999998e-05 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWriteReply(3.2s0 85/31 ECSubWriteReply(tid=57, last_complete=85'56, committed=1, applied=1))", 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492595+0000", 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9141098300000001, 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011137599, 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.476 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.477 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492595+0000", 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492595+0000", 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492597+0000", 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0930000000000001e-06 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492610+0000", 2024-04-26T02:24:58.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2863e-05 2024-04-26T02:24:58.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492639+0000", 2024-04-26T02:24:58.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9136999999999999e-05 2024-04-26T02:24:58.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492659+0000", 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0364999999999999e-05 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.503677+0000", 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011018178999999999 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.503732+0000", 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4962e-05 2024-04-26T02:24:58.482 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs6 85/31 ECSubWrite(tid=47, reqid=osd.7.0:47, at_version=85'37, trim_to=0'0, roll_forward_to=83'35))", 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.494447+0000", 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9122576520000001, 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017858058999999999, 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494447+0000", 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494447+0000", 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494448+0000", 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.7300000000000005e-07 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494502+0000", 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3925999999999998e-05 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494530+0000", 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8869000000000001e-05 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494561+0000", 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0263000000000001e-05 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494851+0000", 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028999400000000002 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.494875+0000", 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4606000000000001e-05 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512216+0000", 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017340924000000001 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512305+0000", 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8603999999999994e-05 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.488 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s5 85/31 ECSubWrite(tid=65, reqid=osd.1.0:65, at_version=85'51, trim_to=0'0, roll_forward_to=84'49))", 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.495878+0000", 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9108260149999996, 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016402987000000001, 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495878+0000", 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495878+0000", 2024-04-26T02:24:58.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495879+0000", 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2399999999999997e-07 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495931+0000", 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.1285000000000001e-05 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495960+0000", 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9249999999999999e-05 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495980+0000", 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0559000000000001e-05 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496137+0000", 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015653999999999999 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496161+0000", 2024-04-26T02:24:58.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4556999999999999e-05 2024-04-26T02:24:58.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512223+0000", 2024-04-26T02:24:58.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016061501999999998 2024-04-26T02:24:58.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.512281+0000", 2024-04-26T02:24:58.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8470000000000001e-05 2024-04-26T02:24:58.496 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.496 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.496 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.496 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:711 3.2s0 3:4ada42ed:::smithi17529564-22:head [append 0~0] snapc 1d=[1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e86)", 2024-04-26T02:24:58.497 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:53.478243+0000", 2024-04-26T02:24:58.497 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.9284618330000001, 2024-04-26T02:24:58.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011466768, 2024-04-26T02:24:58.498 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.498 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 711 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.478243+0000", 2024-04-26T02:24:58.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.478243+0000", 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.478244+0000", 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2729999999999999e-06 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.478251+0000", 2024-04-26T02:24:58.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6540000000000002e-06 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.478269+0000", 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8122999999999999e-05 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.478290+0000", 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1141999999999998e-05 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.485132+0000", 2024-04-26T02:24:58.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006842323 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.485417+0000", 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00028453400000000002 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.486540+0000", 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001123558 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.488388+0000", 2024-04-26T02:24:58.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018475570000000001 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.489588+0000", 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012004100000000001 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:53.489709+0000", 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012119400000000001 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:713 3.2s0 3:492e5739:::smithi17529564-20:head [append 0~0] snapc 1e=[1e,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:54.480683+0000", 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9260213859999999, 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015328391, 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 713 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480683+0000", 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480683+0000", 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480687+0000", 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.206e-06 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480704+0000", 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6246999999999999e-05 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480745+0000", 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.1968999999999997e-05 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480764+0000", 2024-04-26T02:24:58.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8992999999999999e-05 2024-04-26T02:24:58.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480902+0000", 2024-04-26T02:24:58.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000137644 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480916+0000", 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.341e-05 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.485364+0000", 2024-04-26T02:24:58.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044487190000000003 2024-04-26T02:24:58.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.485543+0000", 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000178703 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.486957+0000", 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014141749999999999 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.495185+0000", 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082279880000000003 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.495822+0000", 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063664099999999996 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.496011+0000", 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018969599999999999 2024-04-26T02:24:58.511 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:714 3.2s0 3:492e5739:::smithi17529564-20:head [rollback 1a] snapc 1e=[1e,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:54.480806+0000", 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9258981290000001, 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016128816000000001, 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.512 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 714 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480806+0000", 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480806+0000", 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480808+0000", 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480815+0000", 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6939999999999995e-06 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480836+0000", 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0735999999999999e-05 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480859+0000", 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2929e-05 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.481065+0000", 2024-04-26T02:24:58.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020629599999999999 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.481090+0000", 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4260000000000002e-05 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.489414+0000", 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083247630000000006 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.489750+0000", 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00033539000000000003 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.491604+0000", 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018543100000000001 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.495390+0000", 2024-04-26T02:24:58.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037856550000000002 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.496766+0000", 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013765330000000001 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.496935+0000", 2024-04-26T02:24:58.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016883999999999999 2024-04-26T02:24:58.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.519 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.519 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:715 3.2s0 3:492e5739:::smithi17529564-20:head [append 0~0] snapc 1e=[1e,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e87)", 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:54.480907+0000", 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.9257979540000001, 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016867731, 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 715 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:24:58.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480907+0000", 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480907+0000", 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480908+0000", 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7630000000000001e-06 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480915+0000", 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6599999999999998e-06 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480935+0000", 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9877e-05 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.480949+0000", 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4079e-05 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.481146+0000", 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019730600000000001 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.481156+0000", 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9899999999999992e-06 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.492876+0000", 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011719469 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.493099+0000", 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022306299999999999 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.494331+0000", 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001232691 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.497323+0000", 2024-04-26T02:24:58.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0029913380000000001 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.497656+0000", 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000333171 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:54.497774+0000", 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000118324 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:24:58.525 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:24:58.526 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:24:58.527 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:24:58.528 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:24:58.523+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:24:58.606 INFO:tasks.rados.rados.0.smithi175.stdout:301: done (2 left) 2024-04-26T02:24:58.606 INFO:tasks.rados.rados.0.smithi175.stdout:302: done (1 left) 2024-04-26T02:24:58.606 INFO:tasks.rados.rados.0.smithi175.stdout:303: done (0 left) 2024-04-26T02:24:58.607 INFO:tasks.rados.rados.0.smithi175.stdout:304: rollback oid 44 current snap is 32 2024-04-26T02:24:58.607 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 44 to 30 2024-04-26T02:24:58.607 INFO:tasks.rados.rados.0.smithi175.stdout:305: delete oid 16 current snap is 32 2024-04-26T02:24:58.622 INFO:tasks.rados.rados.0.smithi175.stdout:304: finishing rollback tid 0 to smithi17529564-44 2024-04-26T02:24:58.623 INFO:tasks.rados.rados.0.smithi175.stdout:304: finishing rollback tid 1 to smithi17529564-44 2024-04-26T02:24:58.623 INFO:tasks.rados.rados.0.smithi175.stdout:304: finishing rollback tid 2 to smithi17529564-44 2024-04-26T02:24:58.623 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 44 v 80 (ObjNum 101 snap 13 seq_num 101) dirty exists 2024-04-26T02:24:58.624 INFO:tasks.rados.rados.0.smithi175.stdout:304: done (1 left) 2024-04-26T02:24:58.624 INFO:tasks.rados.rados.0.smithi175.stdout:305: done (0 left) 2024-04-26T02:24:58.624 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 19 current snap is 32 2024-04-26T02:24:58.624 INFO:tasks.rados.rados.0.smithi175.stdout:306: seq_num 138 ranges {2260992=770048,3031040=540672,3571712=753664,4325376=262144} 2024-04-26T02:24:58.630 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:58.625+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:58.655 INFO:tasks.rados.rados.0.smithi175.stdout:306: writing smithi17529564-19 from 2260992 to 3031040 tid 1 2024-04-26T02:24:58.661 INFO:tasks.rados.rados.0.smithi175.stdout:306: writing smithi17529564-19 from 3031040 to 3571712 tid 2 2024-04-26T02:24:58.661 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:58.662 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:58.662 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:58.662 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:58.671 INFO:tasks.rados.rados.0.smithi175.stdout:306: writing smithi17529564-19 from 3571712 to 4325376 tid 3 2024-04-26T02:24:58.674 INFO:tasks.rados.rados.0.smithi175.stdout:306: writing smithi17529564-19 from 4325376 to 4587520 tid 4 2024-04-26T02:24:58.674 INFO:tasks.rados.rados.0.smithi175.stdout:307: snap_remove snap 30 2024-04-26T02:24:58.681 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:24:58.731 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:58.727+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:58.832 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:58.827+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:58.845 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:58.845 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:58.845 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:58.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:24:58.934 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:24:58.929+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:24:58.979 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.979 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 53.940858556000002, 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011126728000000001, 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034940+0000", 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.663e-06 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034988+0000", 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7794999999999999e-05 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035017+0000", 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9139e-05 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035039+0000", 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2178999999999999e-05 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035616+0000", 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057682000000000002 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035639+0000", 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2915999999999999e-05 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045974+0000", 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01033568 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046065+0000", 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0536000000000002e-05 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.983 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=132, reqid=osd.12.0:132, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.409697557999998, 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012148091999999999, 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:58.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566100+0000", 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5400000000000002e-07 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:58.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566148+0000", 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8294999999999998e-05 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566223+0000", 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5108e-05 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566249+0000", 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6033e-05 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566409+0000", 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015976299999999999 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566436+0000", 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7226e-05 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578152+0000", 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011716358 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578247+0000", 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4854999999999999e-05 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.988 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:24:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.408856327999999, 2024-04-26T02:24:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010768801999999999, 2024-04-26T02:24:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:58.989 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566941+0000", 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566993+0000", 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2308999999999997e-05 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567025+0000", 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1934999999999998e-05 2024-04-26T02:24:58.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567047+0000", 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2024000000000001e-05 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567199+0000", 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000151662 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567223+0000", 2024-04-26T02:24:58.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3717e-05 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577442+0000", 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010219257000000001 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577709+0000", 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000267211 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.408699874, 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014918226, 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.994 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567098+0000", 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.463e-06 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567147+0000", 2024-04-26T02:24:58.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8551999999999999e-05 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567169+0000", 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2215999999999999e-05 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567188+0000", 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8756000000000001e-05 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571613+0000", 2024-04-26T02:24:58.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004424936 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9245000000000001e-05 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581898+0000", 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010246251 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.582015+0000", 2024-04-26T02:24:58.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011680699999999999 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.405292459000002, 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013337598000000001, 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:58.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570506+0000", 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.844e-06 2024-04-26T02:24:58.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570590+0000", 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3950999999999996e-05 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570623+0000", 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3315999999999997e-05 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570651+0000", 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7319000000000001e-05 2024-04-26T02:24:59.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571614+0000", 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00096303399999999998 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8068999999999998e-05 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583776+0000", 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012123818999999999 2024-04-26T02:24:59.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583842+0000", 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6246000000000002e-05 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.402932784999997, 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011065805, 2024-04-26T02:24:59.002 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572865+0000", 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9400000000000004e-07 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572920+0000", 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5031999999999998e-05 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572952+0000", 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1992000000000001e-05 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572974+0000", 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1829999999999999e-05 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573193+0000", 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021909100000000001 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573218+0000", 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5363000000000001e-05 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583849+0000", 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010630472 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583930+0000", 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1230999999999995e-05 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=170, reqid=osd.0.0:167, at_version=0'0, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.383390525000003, 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010391315999999999, 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.007 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592407+0000", 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5099999999999998e-07 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592430+0000", 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2971000000000001e-05 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592453+0000", 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2988000000000001e-05 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592470+0000", 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6490999999999998e-05 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594588+0000", 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021184369999999999 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594615+0000", 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6835999999999999e-05 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.602725+0000", 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081098209999999997 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.602798+0000", 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2921000000000002e-05 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 59/31 ECSubWrite(tid=47, reqid=osd.11.0:47, at_version=59'36, trim_to=0'0, roll_forward_to=58'32))", 2024-04-26T02:24:59.011 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.383235401999997, 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009047088, 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:24:59.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592562+0000", 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0999999999999997e-07 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592623+0000", 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0588999999999999e-05 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592692+0000", 2024-04-26T02:24:59.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8748e-05 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592710+0000", 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592963+0000", 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025237000000000002 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592988+0000", 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4916999999999999e-05 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601500+0000", 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085119800000000006 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601608+0000", 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010890100000000001 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=171, reqid=osd.0.0:171, at_version=59'77, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.382350021999997, 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010285917, 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.016 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593448+0000", 2024-04-26T02:24:59.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.435e-06 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593492+0000", 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3446999999999999e-05 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593546+0000", 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4098999999999998e-05 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593567+0000", 2024-04-26T02:24:59.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1435999999999999e-05 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.596136+0000", 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025689850000000002 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.596172+0000", 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6155999999999997e-05 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603019+0000", 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068466730000000002 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603733+0000", 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00071368600000000005 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=172, reqid=osd.0.0:172, at_version=59'79, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.380704299000001, 2024-04-26T02:24:59.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089727690000000002, 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595093+0000", 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017e-06 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595136+0000", 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2545e-05 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595175+0000", 2024-04-26T02:24:59.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9230000000000002e-05 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595194+0000", 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8802000000000001e-05 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.599876+0000", 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046815709999999998 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.599899+0000", 2024-04-26T02:24:59.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3608000000000002e-05 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603988+0000", 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040892289999999998 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.604065+0000", 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6767000000000005e-05 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 66/31 ECSubWrite(tid=52, reqid=osd.11.0:52, at_version=66'38, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.484217356999999, 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097978149999999996, 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491580+0000", 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2600000000000001e-07 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491602+0000", 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2365999999999999e-05 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491639+0000", 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6505999999999999e-05 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491659+0000", 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0976e-05 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491789+0000", 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000129944 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491814+0000", 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4732999999999999e-05 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.501242+0000", 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0094274879999999995 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.501377+0000", 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013557599999999999 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:24:59.029 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.481834184, 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010380267, 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:24:59.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493964+0000", 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8470000000000001e-06 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494018+0000", 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3158999999999997e-05 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494061+0000", 2024-04-26T02:24:59.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3278999999999997e-05 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494103+0000", 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2449e-05 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494599+0000", 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049539600000000005 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494625+0000", 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6075999999999999e-05 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.504220+0000", 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009595091 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.504343+0000", 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012297 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.481539522999999, 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010850225, 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494258+0000", 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1069999999999999e-06 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494289+0000", 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0175000000000002e-05 2024-04-26T02:24:59.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494320+0000", 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1869999999999998e-05 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494360+0000", 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9952e-05 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496568+0000", 2024-04-26T02:24:59.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022078480000000001 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496593+0000", 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4641999999999999e-05 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505054+0000", 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084610469999999993 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505107+0000", 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3584000000000001e-05 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=205, reqid=osd.0.0:205, at_version=66'108, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 25.48007964, 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096827960000000005, 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.038 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495719+0000", 2024-04-26T02:24:59.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7630000000000001e-06 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495769+0000", 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0331999999999999e-05 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495801+0000", 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2089999999999999e-05 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495824+0000", 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2368999999999999e-05 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497475+0000", 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016509960000000001 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497506+0000", 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1126e-05 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505332+0000", 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0078265839999999993 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505400+0000", 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7535999999999998e-05 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(osd.13.22:2 3.7s0 3:e9c97fb0:::smithi17529564-43:head [assert-version v4,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:43.479795+0000", 2024-04-26T02:24:59.042 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.496001558, 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095388049999999992, 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479795+0000", 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479795+0000", 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479798+0000", 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6000000000000001e-06 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479809+0000", 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1212999999999999e-05 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479830+0000", 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1348e-05 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479850+0000", 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0058999999999999e-05 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479928+0000", 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8026000000000001e-05 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479934+0000", 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3870000000000003e-06 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.483150+0000", 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032158479999999999 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.483227+0000", 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7336999999999995e-05 2024-04-26T02:24:59.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.489334+0000", 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061069870000000004 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=77, reqid=osd.11.0:77, at_version=85'63, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.4959429709999998, 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012557278, 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.047 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9299999999999997e-07 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479907+0000", 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2293999999999998e-05 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479938+0000", 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0728999999999997e-05 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479960+0000", 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480947+0000", 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0009871490000000001 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480973+0000", 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5704999999999999e-05 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492318+0000", 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0113448 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3225000000000003e-05 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 85/31 ECSubWrite(tid=84, reqid=osd.8.0:84, at_version=85'61, trim_to=0'0, roll_forward_to=83'59))", 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.4923697169999999, 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011418342, 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483428+0000", 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483486+0000", 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8236999999999998e-05 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483515+0000", 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9169000000000001e-05 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483539+0000", 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4226000000000001e-05 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484639+0000", 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001099952 2024-04-26T02:24:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484657+0000", 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7496999999999999e-05 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494743+0000", 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010086573 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494845+0000", 2024-04-26T02:24:59.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102042 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 6.4912801529999999, 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010793934, 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484518+0000", 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.22e-06 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484568+0000", 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9798e-05 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484599+0000", 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1384999999999999e-05 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484621+0000", 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1818999999999999e-05 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492500+0000", 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007879268 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492527+0000", 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7212e-05 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495235+0000", 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027078060000000001 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495311+0000", 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5426000000000006e-05 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 90/31 ECSubWrite(tid=288, reqid=client.4589.0:736, at_version=90'154, trim_to=0'0, roll_forward_to=88'152))", 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.4885037670000001, 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012431226, 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.060 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487294+0000", 2024-04-26T02:24:59.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7700000000000004e-07 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487571+0000", 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027720199999999999 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487600+0000", 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9028999999999999e-05 2024-04-26T02:24:59.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487617+0000", 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6878999999999999e-05 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487802+0000", 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018537999999999999 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487856+0000", 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4237000000000003e-05 2024-04-26T02:24:59.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499640+0000", 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011783903 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499724+0000", 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4018999999999996e-05 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 90/31 ECSubWrite(tid=289, reqid=client.4589.0:737, at_version=90'156, trim_to=0'0, roll_forward_to=88'152))", 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.489653+0000", 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.486144194, 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010172966, 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489653+0000", 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489653+0000", 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489655+0000", 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.446e-06 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489707+0000", 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2237999999999997e-05 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489741+0000", 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4032999999999998e-05 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489765+0000", 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3679000000000001e-05 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489916+0000", 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015152699999999999 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489942+0000", 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5479000000000001e-05 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499745+0000", 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098032439999999992 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499826+0000", 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0320000000000003e-05 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.068 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.069 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.069 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.069 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.069 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:59.070 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:24:59.071 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:59.067+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:59.171 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:24:59.167+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:24:59.239 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:59.239 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:59.239 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:59.240 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:59.254 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:24:59.271 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:24:59.267+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:24:59.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:24:59.372 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:24:59.372 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:24:59.372 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:59.373 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:24:59.371+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:24:59.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:24:59.473 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:24:59.468+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:24:59.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T02:24:59.512 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:59.512 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:24:59.512 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:24:59.512 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:24:59.512 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:406 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~475136] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 36.714401170000002, 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010860336999999999, 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 406 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.513 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794007+0000", 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4770000000000002e-06 2024-04-26T02:24:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794660+0000", 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065313299999999997 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794694+0000", 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4014999999999999e-05 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794716+0000", 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2846000000000001e-05 2024-04-26T02:24:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795033+0000", 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000316965 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795302+0000", 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268853 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.797207+0000", 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019045690000000001 2024-04-26T02:24:59.516 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803798+0000", 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006591281 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804729+0000", 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00093087200000000001 2024-04-26T02:24:59.517 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804864+0000", 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013532600000000001 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:407 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~294912] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 36.712945286, 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010087191000000001, 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.518 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 407 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.519 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795460+0000", 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795462+0000", 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.674e-06 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795803+0000", 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00034131400000000001 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.520 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795847+0000", 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4518999999999998e-05 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795869+0000", 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1892e-05 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.799486+0000", 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0036169510000000002 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.799575+0000", 2024-04-26T02:24:59.521 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8862000000000004e-05 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.800084+0000", 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00050842200000000002 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.522 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803800+0000", 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037168539999999999 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805437+0000", 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001636593 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805547+0000", 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011011 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.523 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:408 3.bs0 3:d145576f:::smithi17529564-17:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 36.712493498000001, 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010110317000000001, 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 408 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.524 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795912+0000", 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795913+0000", 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7969999999999999e-06 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795923+0000", 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1970000000000002e-06 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795946+0000", 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3584999999999999e-05 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795962+0000", 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5503999999999999e-05 2024-04-26T02:24:59.526 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.801481+0000", 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.005519665 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.801733+0000", 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025184099999999999 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803057+0000", 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013241139999999999 2024-04-26T02:24:59.527 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805141+0000", 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002083175 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.805932+0000", 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079104900000000005 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.528 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.529 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806022+0000", 2024-04-26T02:24:59.529 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0389999999999993e-05 2024-04-26T02:24:59.529 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.530 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.530 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.530 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.530 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:409 3.bs0 3:d145576f:::smithi17529564-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 36.712416705999999, 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013475743, 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 409 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.531 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:24:59.532 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795990+0000", 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.42e-06 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795995+0000", 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5799999999999999e-06 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.533 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796017+0000", 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1778999999999999e-05 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796033+0000", 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6022999999999999e-05 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806706+0000", 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010672472000000001 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806946+0000", 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024007 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809464+0000", 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025183990000000002 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:413 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~131072] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:59.535 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 36.694599199000002, 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011855436, 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 413 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.536 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813808+0000", 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0200000000000001e-06 2024-04-26T02:24:59.537 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813887+0000", 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9437999999999994e-05 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813913+0000", 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5082000000000001e-05 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813931+0000", 2024-04-26T02:24:59.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.859e-05 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818168+0000", 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042373460000000003 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818314+0000", 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000145289 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819109+0000", 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079474400000000001 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825348+0000", 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062396159999999999 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825501+0000", 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152583 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825661+0000", 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016072800000000001 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.541 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:414 3.bs0 3:db601e58:::smithi17529564-10:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 36.694442826, 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012515695, 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.542 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 414 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813964+0000", 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.59e-06 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813973+0000", 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6689999999999995e-06 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813993+0000", 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0440000000000001e-05 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814007+0000", 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4073000000000001e-05 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819880+0000", 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058725599999999998 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820055+0000", 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017564800000000001 2024-04-26T02:24:59.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820866+0000", 2024-04-26T02:24:59.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000810299 2024-04-26T02:24:59.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826013+0000", 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051474570000000002 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826385+0000", 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00037209199999999997 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826478+0000", 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2867000000000004e-05 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.549 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:415 3.bs0 3:db601e58:::smithi17529564-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 36.694378391999997, 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014775608000000001, 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.550 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 415 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814028+0000", 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2270000000000001e-06 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814034+0000", 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6230000000000002e-06 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814070+0000", 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6513000000000001e-05 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814083+0000", 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.332e-05 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821842+0000", 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077589859999999998 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821934+0000", 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1736000000000004e-05 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826791+0000", 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048572470000000003 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826870+0000", 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8065999999999994e-05 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.828802+0000", 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00193289 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.554 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.940257901999999, 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01558203, 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568148+0000", 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5300000000000004e-07 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568196+0000", 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8158999999999997e-05 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568232+0000", 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5565999999999998e-05 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568269+0000", 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568551+0000", 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028192700000000001 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568576+0000", 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5171999999999999e-05 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583637+0000", 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015060841 2024-04-26T02:24:59.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583729+0000", 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2570000000000003e-05 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.938859284999999, 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015014527, 2024-04-26T02:24:59.559 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569547+0000", 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-07 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569597+0000", 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0417999999999997e-05 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569626+0000", 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9087000000000001e-05 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569648+0000", 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1869e-05 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569790+0000", 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014197 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569814+0000", 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3748999999999999e-05 2024-04-26T02:24:59.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584483+0000", 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014669006 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584560+0000", 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7785000000000001e-05 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.933314607, 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010327464999999999, 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575092+0000", 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575136+0000", 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4712000000000002e-05 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575161+0000", 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4396000000000002e-05 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575179+0000", 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8445999999999999e-05 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575319+0000", 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013968699999999999 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575344+0000", 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5153000000000001e-05 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585327+0000", 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099826429999999994 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585418+0000", 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1471000000000006e-05 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.933161568000003, 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012320048, 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.568 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575245+0000", 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1039999999999999e-06 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575287+0000", 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2122000000000001e-05 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575310+0000", 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3139999999999999e-05 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575328+0000", 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7932e-05 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575669+0000", 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340749 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575694+0000", 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587485+0000", 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01179094 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587564+0000", 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8610999999999997e-05 2024-04-26T02:24:59.572 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.932989804999998, 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013969232, 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575416+0000", 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6000000000000004e-07 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575457+0000", 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1006e-05 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575475+0000", 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8280000000000001e-05 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575492+0000", 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6455000000000001e-05 2024-04-26T02:24:59.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575788+0000", 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029676700000000003 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575812+0000", 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3866000000000002e-05 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589304+0000", 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013491306999999999 2024-04-26T02:24:59.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589385+0000", 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0990999999999998e-05 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:24:59.577 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.932095095999998, 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013188284, 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576312+0000", 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.88e-06 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576362+0000", 2024-04-26T02:24:59.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9518999999999998e-05 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576392+0000", 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0278999999999999e-05 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576413+0000", 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0879000000000001e-05 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576631+0000", 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000217858 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576656+0000", 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5230000000000001e-05 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589395+0000", 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012739034999999999 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589498+0000", 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010360400000000001 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=73, reqid=osd.8.0:72, at_version=0'0, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 32.917085368999999, 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099689510000000002, 2024-04-26T02:24:59.582 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591320+0000", 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591321+0000", 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6440000000000001e-06 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591346+0000", 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4842999999999999e-05 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591374+0000", 2024-04-26T02:24:59.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7705999999999999e-05 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591394+0000", 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0003000000000001e-05 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591560+0000", 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000165966 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591587+0000", 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7291999999999999e-05 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601222+0000", 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096350700000000008 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601289+0000", 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6427000000000006e-05 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.586 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:520 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.039003210000001, 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013039524, 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.587 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 520 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469405+0000", 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.993e-06 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469418+0000", 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2693e-05 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469453+0000", 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5679000000000002e-05 2024-04-26T02:24:59.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469482+0000", 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8943000000000001e-05 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469661+0000", 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000178486 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469674+0000", 2024-04-26T02:24:59.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3112000000000001e-05 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473010+0000", 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033360080000000001 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473163+0000", 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000153323 2024-04-26T02:24:59.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.474753+0000", 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001589752 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482102+0000", 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073493830000000001 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482270+0000", 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000167176 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482442+0000", 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017197600000000001 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.593 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:521 3.bs0 3:db601e58:::smithi17529564-10:head [rollback d] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.038865229999999, 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013833965, 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 521 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469541+0000", 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.513e-06 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469548+0000", 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0129999999999996e-06 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469570+0000", 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1146e-05 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469590+0000", 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0089e-05 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469805+0000", 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000215672 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469818+0000", 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2527000000000001e-05 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476615+0000", 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067965919999999997 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476905+0000", 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029089300000000002 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.478553+0000", 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016476380000000001 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482879+0000", 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043259839999999997 2024-04-26T02:24:59.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483241+0000", 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036179499999999999 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483374+0000", 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000133103 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:522 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 31.038758723000001, 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015161644, 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 522 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469648+0000", 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.77e-06 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469654+0000", 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.117e-06 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469675+0000", 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0455e-05 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469692+0000", 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T02:24:59.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469872+0000", 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017992299999999999 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469881+0000", 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5959999999999993e-06 2024-04-26T02:24:59.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479445+0000", 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095639639999999995 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479611+0000", 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016535200000000001 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.480621+0000", 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00101044 2024-04-26T02:24:59.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482888+0000", 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022665620000000002 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484697+0000", 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018098109999999999 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484808+0000", 2024-04-26T02:24:59.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110754 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.032107409999998, 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010206114000000001, 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476299+0000", 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9299999999999996e-07 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476352+0000", 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3522e-05 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476382+0000", 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0116000000000001e-05 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476404+0000", 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2135999999999999e-05 2024-04-26T02:24:59.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476629+0000", 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022486899999999999 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476656+0000", 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6176000000000001e-05 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.486405+0000", 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097497039999999997 2024-04-26T02:24:59.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.486504+0000", 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8697999999999996e-05 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.030880580000002, 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013025037999999999, 2024-04-26T02:24:59.610 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477526+0000", 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3e-06 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477587+0000", 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1579000000000001e-05 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477611+0000", 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3560000000000001e-05 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477623+0000", 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2149e-05 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480063+0000", 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024397440000000002 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480088+0000", 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5295000000000001e-05 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490508+0000", 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010419741 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490550+0000", 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1669999999999999e-05 2024-04-26T02:24:59.614 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 26.029233731000001, 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011565971, 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:24:59.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479172+0000", 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9500000000000001e-07 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479197+0000", 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5130000000000002e-05 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479209+0000", 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.15e-05 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:24:59.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479218+0000", 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2199999999999998e-06 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480190+0000", 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00097207200000000004 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480199+0000", 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3739999999999998e-06 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:24:59.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490652+0000", 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010453069000000001 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490737+0000", 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5810999999999995e-05 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:24:59.619 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:59.620 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:24:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:24:59.621 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:24:59.622 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:24:59.622 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:24:59.623 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:24:59.623 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:307: done (1 left) 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:308: read oid 6 snap 24 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:308: expect (ObjNum 102 snap 13 seq_num 102) 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 13 current snap is 32 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:306: finishing write tid 1 to smithi17529564-19 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:306: finishing write tid 2 to smithi17529564-19 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:306: finishing write tid 3 to smithi17529564-19 2024-04-26T02:24:59.624 INFO:tasks.rados.rados.0.smithi175.stdout:309: seq_num 139 ranges {0=786432,786432=688128,1474560=475136,1949696=393216} 2024-04-26T02:24:59.625 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:24:59.616+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:24:59.625 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:24:59.625 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:24:59.625 INFO:tasks.rados.rados.0.smithi175.stdout:309: writing smithi17529564-13 from 0 to 786432 tid 1 2024-04-26T02:24:59.626 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:24:59.626 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:24:59.632 INFO:tasks.rados.rados.0.smithi175.stdout:309: writing smithi17529564-13 from 786432 to 1474560 tid 2 2024-04-26T02:24:59.639 INFO:tasks.rados.rados.0.smithi175.stdout:309: writing smithi17529564-13 from 1474560 to 1949696 tid 3 2024-04-26T02:24:59.642 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:24:59.643 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:24:59.645 INFO:tasks.rados.rados.0.smithi175.stdout:309: writing smithi17529564-13 from 1949696 to 2342912 tid 4 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:310: rmattr oid 12 current snap is 32 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:310: done (3 left) 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:311: copy_from oid 39 from oid 27 current snap is 32 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:306: finishing write tid 4 to smithi17529564-19 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:306: finishing write tid 5 to smithi17529564-19 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:306: finishing write tid 6 to smithi17529564-19 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:306: oid 19 updating version 0 to 70 2024-04-26T02:24:59.647 INFO:tasks.rados.rados.0.smithi175.stdout:306: oid 19 updating version 70 to 73 2024-04-26T02:24:59.648 INFO:tasks.rados.rados.0.smithi175.stdout:306: oid 19 version 73 is already newer than 71 2024-04-26T02:24:59.648 INFO:tasks.rados.rados.0.smithi175.stdout:306: oid 19 version 73 is already newer than 69 2024-04-26T02:24:59.648 INFO:tasks.rados.rados.0.smithi175.stdout:306: oid 19 version 73 is already newer than 72 2024-04-26T02:24:59.648 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 19 v 73 (ObjNum 138 snap 32 seq_num 138) dirty exists 2024-04-26T02:24:59.648 INFO:tasks.rados.rados.0.smithi175.stdout:306: left oid 19 (ObjNum 138 snap 32 seq_num 138) 2024-04-26T02:24:59.648 INFO:tasks.rados.rados.0.smithi175.stdout:306: done (3 left) 2024-04-26T02:24:59.648 INFO:tasks.rados.rados.0.smithi175.stdout:312: delete oid 50 current snap is 32 2024-04-26T02:24:59.650 INFO:tasks.rados.rados.0.smithi175.stdout:309: finishing write tid 1 to smithi17529564-13 2024-04-26T02:24:59.653 INFO:tasks.rados.rados.0.smithi175.stdout:309: finishing write tid 2 to smithi17529564-13 2024-04-26T02:24:59.655 INFO:tasks.rados.rados.0.smithi175.stdout:309: finishing write tid 3 to smithi17529564-13 2024-04-26T02:24:59.655 INFO:tasks.rados.rados.0.smithi175.stdout:309: finishing write tid 4 to smithi17529564-13 2024-04-26T02:24:59.655 INFO:tasks.rados.rados.0.smithi175.stdout:309: finishing write tid 5 to smithi17529564-13 2024-04-26T02:24:59.656 INFO:tasks.rados.rados.0.smithi175.stdout:312: done (3 left) 2024-04-26T02:24:59.656 INFO:tasks.rados.rados.0.smithi175.stdout:313: rollback oid 33 current snap is 32 2024-04-26T02:24:59.656 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 33 to 23 2024-04-26T02:24:59.656 INFO:tasks.rados.rados.0.smithi175.stdout:314: read oid 11 snap -1 2024-04-26T02:24:59.656 INFO:tasks.rados.rados.0.smithi175.stdout:314: expect deleted 2024-04-26T02:24:59.656 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 19 current snap is 32 2024-04-26T02:24:59.657 INFO:tasks.rados.rados.0.smithi175.stdout:315: seq_num 141 ranges {4587520=425984,5013504=573440,5586944=425984,6012928=524288,6537216=425984} 2024-04-26T02:24:59.673 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:24:59.673 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:24:59.685 INFO:tasks.rados.rados.0.smithi175.stdout:315: writing smithi17529564-19 from 4587520 to 5013504 tid 1 2024-04-26T02:24:59.688 INFO:tasks.rados.rados.0.smithi175.stdout:315: writing smithi17529564-19 from 5013504 to 5586944 tid 2 2024-04-26T02:24:59.691 INFO:tasks.rados.rados.0.smithi175.stdout:315: writing smithi17529564-19 from 5586944 to 6012928 tid 3 2024-04-26T02:24:59.692 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:24:59.693 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:24:59.694 INFO:tasks.rados.rados.0.smithi175.stdout:315: writing smithi17529564-19 from 6012928 to 6537216 tid 4 2024-04-26T02:24:59.697 INFO:tasks.rados.rados.0.smithi175.stdout:315: writing smithi17529564-19 from 6537216 to 6963200 tid 5 2024-04-26T02:24:59.697 INFO:tasks.rados.rados.0.smithi175.stdout:316: snap_create 2024-04-26T02:24:59.697 INFO:tasks.rados.rados.0.smithi175.stdout:309: finishing write tid 6 to smithi17529564-13 2024-04-26T02:24:59.697 INFO:tasks.rados.rados.0.smithi175.stdout:309: oid 13 updating version 0 to 168 2024-04-26T02:24:59.697 INFO:tasks.rados.rados.0.smithi175.stdout:309: oid 13 version 168 is already newer than 163 2024-04-26T02:24:59.697 INFO:tasks.rados.rados.0.smithi175.stdout:309: oid 13 updating version 168 to 169 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:309: oid 13 updating version 169 to 171 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:309: oid 13 version 171 is already newer than 170 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 13 v 171 (ObjNum 139 snap 32 seq_num 139) dirty exists 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:309: left oid 13 (ObjNum 139 snap 32 seq_num 139) 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:311: finishing copy_from racing read to smithi17529564-39 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:311: finishing copy_from to smithi17529564-39 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 39 v 26 (ObjNum 273 snap 0 seq_num 0) dirty exists 2024-04-26T02:24:59.698 INFO:tasks.rados.rados.0.smithi175.stdout:308: expect (ObjNum 102 snap 13 seq_num 102) 2024-04-26T02:24:59.710 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:24:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:24:59.721 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:24:59.718+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:24:59.731 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:24:59.731 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:24:59.752 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:24:59.752 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:24:59.763 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:24:59.763 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:24:59.763 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:24:59.763 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:24:59.771 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:24:59.771 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:24:59.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:24:59.789 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:24:59.789 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:24:59.809 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:24:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:24:59.822 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:24:59.819+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:24:59.829 INFO:teuthology.orchestra.run.smithi059.stdout:osd.14: {} 2024-04-26T02:24:59.829 INFO:teuthology.orchestra.run.smithi059.stderr:osd.14: osd_enable_op_tracker = '' 2024-04-26T02:24:59.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:24:59.826+0000 7f976f7fe640 0 -- 172.21.15.59:0/3168312900 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f97702244a0 msgr2=0x7f9770226890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-04-26T02:24:59.910 INFO:tasks.rados.rados.0.smithi175.stdout:313: finishing rollback tid 0 to smithi17529564-33 2024-04-26T02:24:59.910 INFO:tasks.rados.rados.0.smithi175.stdout:313: finishing rollback tid 1 to smithi17529564-33 2024-04-26T02:24:59.910 INFO:tasks.rados.rados.0.smithi175.stdout:313: finishing rollback tid 2 to smithi17529564-33 2024-04-26T02:24:59.910 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 33 v 71 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-04-26T02:24:59.910 INFO:tasks.rados.rados.0.smithi175.stdout:315: finishing write tid 1 to smithi17529564-19 2024-04-26T02:24:59.910 INFO:tasks.rados.rados.0.smithi175.stdout:315: finishing write tid 2 to smithi17529564-19 2024-04-26T02:24:59.910 INFO:tasks.rados.rados.0.smithi175.stdout:315: finishing write tid 3 to smithi17529564-19 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: finishing write tid 4 to smithi17529564-19 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: finishing write tid 5 to smithi17529564-19 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: finishing write tid 6 to smithi17529564-19 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: finishing write tid 7 to smithi17529564-19 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: oid 19 updating version 0 to 76 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: oid 19 updating version 76 to 81 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: oid 19 version 81 is already newer than 78 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: oid 19 version 81 is already newer than 79 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: oid 19 version 81 is already newer than 77 2024-04-26T02:24:59.911 INFO:tasks.rados.rados.0.smithi175.stdout:315: oid 19 version 81 is already newer than 80 2024-04-26T02:24:59.912 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 19 v 81 (ObjNum 141 snap 32 seq_num 141) dirty exists 2024-04-26T02:24:59.912 INFO:tasks.rados.rados.0.smithi175.stdout:315: left oid 19 (ObjNum 141 snap 32 seq_num 141) 2024-04-26T02:24:59.922 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:24:59.916+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:24:59.947 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:24:59.947 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:24:59.961 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:25:00.023 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:00.018+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:00.054 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:25:00.055 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:25:00.124 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:00.119+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:00.133 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:00.133 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:00.147 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:25:00.225 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:25:00.219+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:25:00.269 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:00.269 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:00.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:25:00.326 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:00.322+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:00.405 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:00.405 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:00.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:25:00.426 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:25:00.423+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:25:00.527 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:00.522+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:00.537 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:00.537 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:00.553 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:25:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:308: done (6 left) 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:309: done (5 left) 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:311: done (4 left) 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:313: done (3 left) 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:314: done (2 left) 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:315: done (1 left) 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:316: done (0 left) 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:317: copy_from oid 44 from oid 14 current snap is 33 2024-04-26T02:25:00.623 INFO:tasks.rados.rados.0.smithi175.stdout:318: delete oid 36 current snap is 33 2024-04-26T02:25:00.628 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:00.622+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:00.634 INFO:tasks.rados.rados.0.smithi175.stdout:318: done (1 left) 2024-04-26T02:25:00.634 INFO:tasks.rados.rados.0.smithi175.stdout:319: read oid 16 snap -1 2024-04-26T02:25:00.634 INFO:tasks.rados.rados.0.smithi175.stdout:319: expect deleted 2024-04-26T02:25:00.634 INFO:tasks.rados.rados.0.smithi175.stdout:320: copy_from oid 5 from oid 37 current snap is 33 2024-04-26T02:25:00.634 INFO:tasks.rados.rados.0.smithi175.stdout:321: snap_create 2024-04-26T02:25:00.645 INFO:tasks.rados.rados.0.smithi175.stdout:317: finishing copy_from racing read to smithi17529564-44 2024-04-26T02:25:00.652 INFO:tasks.rados.rados.0.smithi175.stdout:317: finishing copy_from to smithi17529564-44 2024-04-26T02:25:00.652 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 44 v 24 (ObjNum 82 snap 8 seq_num 82) dirty exists 2024-04-26T02:25:00.662 INFO:tasks.rados.rados.0.smithi175.stdout:320: finishing copy_from racing read to smithi17529564-5 2024-04-26T02:25:00.665 INFO:tasks.rados.rados.0.smithi175.stdout:320: finishing copy_from to smithi17529564-5 2024-04-26T02:25:00.666 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 5 v 18 (ObjNum 61 snap 3 seq_num 61) dirty exists 2024-04-26T02:25:00.687 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:00.688 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:00.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:25:00.729 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:00.727+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:00.830 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:25:00.827+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:25:00.861 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:00.861 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:00.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:25:00.930 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:00.927+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:01.004 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:01.004 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:01.020 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:25:01.031 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:01.027+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:01.132 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:01.130+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:01.139 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:01.139 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:01.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:25:01.233 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:01.227+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:01.321 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:01.321 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:01.334 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:01.332+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:01.335 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:25:01.435 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:25:01.431+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:25:01.457 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:01.457 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:01.471 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:25:01.536 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:25:01.531+0000 7fb928f60640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 14 (PID: 25085) UID: 0 2024-04-26T02:25:01.593 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:01.594 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:01.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:25:01.630 INFO:tasks.rados.rados.0.smithi175.stdout:317: done (3 left) 2024-04-26T02:25:01.630 INFO:tasks.rados.rados.0.smithi175.stdout:319: done (2 left) 2024-04-26T02:25:01.630 INFO:tasks.rados.rados.0.smithi175.stdout:320: done (1 left) 2024-04-26T02:25:01.630 INFO:tasks.rados.rados.0.smithi175.stdout:321: done (0 left) 2024-04-26T02:25:01.630 INFO:tasks.rados.rados.0.smithi175.stdout:322: rollback oid 3 current snap is 34 2024-04-26T02:25:01.630 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 3 to 14 2024-04-26T02:25:01.631 INFO:tasks.rados.rados.0.smithi175.stdout:323: copy_from oid 25 from oid 11 current snap is 34 2024-04-26T02:25:01.631 INFO:tasks.rados.rados.0.smithi175.stdout:324: snap_remove snap 24 2024-04-26T02:25:01.637 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:01.632+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:01.718 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:25:01.718 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:25:01.718 INFO:tasks.thrashosds.thrasher:Killing osd 14, live_osds are [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 14, 3, 7, 11, 15] 2024-04-26T02:25:01.719 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2024-04-26T02:25:01.719 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:25:01.738 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:01.738 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:01.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:25:01.762 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:01.759+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:01.815 INFO:tasks.ceph.osd.14:Stopped 2024-04-26T02:25:01.815 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.14 2024-04-26T02:25:01.815 INFO:tasks.thrashosds.thrasher:remote for osd 14 is ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:25:01.815 DEBUG:teuthology.orchestra.run.smithi142:> type ceph-objectstore-tool 2024-04-26T02:25:01.839 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:01.834+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:01.862 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T02:25:01.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-14 --journal-path /var/lib/ceph/osd/ceph-14/journal --op list-pgs 2024-04-26T02:25:01.880 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:01.880 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:01.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:25:01.981 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:01.978+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:02.041 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:25:02.036+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:25:02.069 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:02.069 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:02.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:25:02.084 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:25:02.173 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:02.170+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:02.243 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:02.239+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:02.249 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:02.249 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:02.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:25:02.276 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:25:02.277 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:25:02.297 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:25:02.298 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:25:02.318 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:25:02.318 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:25:02.338 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:25:02.339 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:25:02.343 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:02.339+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:02.358 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:25:02.358 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:25:02.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:25:02.379 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:25:02.405 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:02.405 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:02.413 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:25:02.413 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:25:02.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:25:02.434 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:25:02.434 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:25:02.444 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:02.439+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:02.451 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:25:02.451 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:25:02.469 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:25:02.469 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:25:02.479 INFO:tasks.rados.rados.0.smithi175.stdout:324: done (2 left) 2024-04-26T02:25:02.479 INFO:tasks.rados.rados.0.smithi175.stdout:325: read oid 34 snap -1 2024-04-26T02:25:02.479 INFO:tasks.rados.rados.0.smithi175.stdout:325: expect (ObjNum 86 snap 12 seq_num 86) 2024-04-26T02:25:02.479 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 37 current snap is 34 2024-04-26T02:25:02.479 INFO:tasks.rados.rados.0.smithi175.stdout:326: seq_num 143 ranges {1638400=458752,2097152=475136,2572288=655360,3227648=671744,3899392=147456} 2024-04-26T02:25:02.492 INFO:tasks.rados.rados.0.smithi175.stdout:326: writing smithi17529564-37 from 1638400 to 2097152 tid 1 2024-04-26T02:25:02.495 INFO:tasks.rados.rados.0.smithi175.stdout:326: writing smithi17529564-37 from 2097152 to 2572288 tid 2 2024-04-26T02:25:02.500 INFO:tasks.rados.rados.0.smithi175.stdout:326: writing smithi17529564-37 from 2572288 to 3227648 tid 3 2024-04-26T02:25:02.502 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:25:02.502 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:25:02.504 INFO:tasks.rados.rados.0.smithi175.stdout:326: writing smithi17529564-37 from 3227648 to 3899392 tid 4 2024-04-26T02:25:02.506 INFO:tasks.rados.rados.0.smithi175.stdout:326: writing smithi17529564-37 from 3899392 to 4046848 tid 5 2024-04-26T02:25:02.506 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 6 current snap is 34 2024-04-26T02:25:02.506 INFO:tasks.rados.rados.0.smithi175.stdout:327: seq_num 144 ranges {4358144=16384} 2024-04-26T02:25:02.531 INFO:tasks.rados.rados.0.smithi175.stdout:327: writing smithi17529564-6 from 4358144 to 4374528 tid 1 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:328: read oid 38 snap -1 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:328: expect deleted 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:329: setattr oid 29 current snap is 34 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:323: finishing copy_from to smithi17529564-25 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:323: got expected ENOENT (src dne) 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:323: finishing copy_from racing read to smithi17529564-25 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:322: finishing rollback tid 1 to smithi17529564-3 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:322: finishing rollback tid 2 to smithi17529564-3 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 3 v 44 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-04-26T02:25:02.532 INFO:tasks.rados.rados.0.smithi175.stdout:325: expect (ObjNum 86 snap 12 seq_num 86) 2024-04-26T02:25:02.533 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:25:02.533 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:25:02.545 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:02.542+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:02.551 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:25:02.551 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:25:02.566 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:02.566 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:02.566 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:25:02.566 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:02.568 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:25:02.569 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:25:02.581 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:25:02.589 INFO:tasks.rados.rados.0.smithi175.stdout:326: finishing write tid 1 to smithi17529564-37 2024-04-26T02:25:02.589 INFO:tasks.rados.rados.0.smithi175.stdout:326: finishing write tid 2 to smithi17529564-37 2024-04-26T02:25:02.589 INFO:tasks.rados.rados.0.smithi175.stdout:326: finishing write tid 3 to smithi17529564-37 2024-04-26T02:25:02.589 INFO:tasks.rados.rados.0.smithi175.stdout:326: finishing write tid 4 to smithi17529564-37 2024-04-26T02:25:02.589 INFO:tasks.rados.rados.0.smithi175.stdout:326: finishing write tid 5 to smithi17529564-37 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: finishing write tid 6 to smithi17529564-37 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: finishing write tid 7 to smithi17529564-37 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: oid 37 updating version 0 to 105 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: oid 37 version 105 is already newer than 104 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: oid 37 version 105 is already newer than 103 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: oid 37 version 105 is already newer than 101 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: oid 37 updating version 105 to 106 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: oid 37 version 106 is already newer than 102 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 37 v 106 (ObjNum 143 snap 34 seq_num 143) dirty exists 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:326: left oid 37 (ObjNum 143 snap 34 seq_num 143) 2024-04-26T02:25:02.590 INFO:tasks.rados.rados.0.smithi175.stdout:322: done (6 left) 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:323: done (5 left) 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:325: done (4 left) 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:326: done (3 left) 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:328: done (2 left) 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:330: read oid 8 snap -1 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:330: expect (ObjNum 130 snap 27 seq_num 130) 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:331: setattr oid 38 current snap is 34 2024-04-26T02:25:02.591 INFO:tasks.rados.rados.0.smithi175.stdout:332: snap_create 2024-04-26T02:25:02.596 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 29 v 76 (ObjNum 113 snap 0 seq_num 3848221531) dirty exists 2024-04-26T02:25:02.597 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 38 v 74 (ObjNum 49 snap 0 seq_num 3111987408) dirty exists 2024-04-26T02:25:02.612 INFO:tasks.rados.rados.0.smithi175.stdout:330: expect (ObjNum 130 snap 27 seq_num 130) 2024-04-26T02:25:02.646 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:02.640+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:02.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:25:02.703 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:02.703 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:02.703 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:25:02.703 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:25:02.703 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:02.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:25:02.763 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:02.759+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:02.840 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:02.840 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:25:02.840 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:25:02.840 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:25:02.840 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.840 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.270679565000002, 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012199435999999999, 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566029+0000", 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566086+0000", 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6326000000000002e-05 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566114+0000", 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8186000000000001e-05 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566138+0000", 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4130000000000001e-05 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566303+0000", 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016472500000000001 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.843 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566327+0000", 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4386999999999999e-05 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578144+0000", 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011816432999999999 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578228+0000", 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4561999999999994e-05 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.844 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.845 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.845 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.845 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:02.845 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.567191+0000", 2024-04-26T02:25:02.845 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.2695176, 2024-04-26T02:25:02.845 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013432176000000001, 2024-04-26T02:25:02.846 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.846 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.846 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.846 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.846 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567191+0000", 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567191+0000", 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.847 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567192+0000", 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.813e-06 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567260+0000", 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7366000000000005e-05 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567291+0000", 2024-04-26T02:25:02.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1625999999999998e-05 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567312+0000", 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0942999999999999e-05 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567842+0000", 2024-04-26T02:25:02.849 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000530015 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.567942+0000", 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9499000000000004e-05 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580519+0000", 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012576942000000001 2024-04-26T02:25:02.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.851 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.580623+0000", 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103972 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.852 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.570894+0000", 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.265814167000002, 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012106647, 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570894+0000", 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.853 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570894+0000", 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570896+0000", 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8300000000000001e-06 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570951+0000", 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5038999999999999e-05 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.570983+0000", 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2344000000000001e-05 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.571006+0000", 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3045999999999999e-05 2024-04-26T02:25:02.855 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573955+0000", 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002948942 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573983+0000", 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7373e-05 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.582913+0000", 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0089305370000000005 2024-04-26T02:25:02.856 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.583001+0000", 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7535999999999997e-05 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:513 3.0s0 3:0bf26ae6:::smithi17529564-36:head [append 0~622592] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.498269+0000", 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.338438969000002, 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011959111, 2024-04-26T02:25:02.857 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 513 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.498269+0000", 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.858 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.498269+0000", 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.498272+0000", 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7700000000000002e-06 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499538+0000", 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001266386 2024-04-26T02:25:02.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499572+0000", 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3469000000000001e-05 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499587+0000", 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5586999999999998e-05 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.499752+0000", 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016427100000000001 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.500059+0000", 2024-04-26T02:25:02.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000307177 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.503353+0000", 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0032943920000000002 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.509502+0000", 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061491569999999997 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510035+0000", 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00053225099999999997 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.510228+0000", 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019365100000000001 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.863 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:518 3.0s0 3:0bf26ae6:::smithi17529564-36:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:27.511911+0000", 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.324797359000002, 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014919874, 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:02.864 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 518 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511911+0000", 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511911+0000", 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511912+0000", 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0699999999999996e-07 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511917+0000", 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3090000000000003e-06 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511947+0000", 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9697e-05 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.511960+0000", 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3186999999999999e-05 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.521178+0000", 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092181810000000006 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:02.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.521326+0000", 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000147775 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.523387+0000", 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020608779999999999 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.523572+0000", 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018491100000000001 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.868 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:27.526831+0000", 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0032590290000000001 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 66/31 ECSubWrite(tid=201, reqid=osd.0.0:201, at_version=66'104, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.473967+0000", 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.362741314000001, 2024-04-26T02:25:02.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016992693, 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.473967+0000", 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.473967+0000", 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.473968+0000", 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6599999999999996e-07 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474032+0000", 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.4284999999999999e-05 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474058+0000", 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6041999999999999e-05 2024-04-26T02:25:02.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474079+0000", 2024-04-26T02:25:02.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0795999999999999e-05 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474264+0000", 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018564499999999999 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474290+0000", 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5269000000000002e-05 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.873 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490867+0000", 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016577034000000001 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490960+0000", 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2955999999999996e-05 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.874 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.474158+0000", 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.362550391999999, 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011861017999999999, 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474158+0000", 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474158+0000", 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474159+0000", 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.046e-06 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474201+0000", 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.2101999999999998e-05 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474225+0000", 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4009e-05 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474244+0000", 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.874e-05 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474439+0000", 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019479100000000001 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.877 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.474464+0000", 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5119000000000001e-05 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485946+0000", 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011481954000000001 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486019+0000", 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3256999999999993e-05 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.878 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475709+0000", 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.360999240000002, 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015346538, 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.879 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475709+0000", 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475709+0000", 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475716+0000", 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6229999999999999e-06 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475766+0000", 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9938000000000002e-05 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475904+0000", 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000138474 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475926+0000", 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2011999999999999e-05 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478279+0000", 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002352682 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478303+0000", 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4156e-05 2024-04-26T02:25:02.882 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490997+0000", 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012694643 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491056+0000", 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8010000000000002e-05 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475802+0000", 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.360905784, 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015258839, 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475802+0000", 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475802+0000", 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475803+0000", 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7000000000000004e-07 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475846+0000", 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.3291999999999998e-05 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3598999999999999e-05 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475887+0000", 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7201999999999999e-05 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476231+0000", 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034379899999999999 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476253+0000", 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2126000000000001e-05 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490991+0000", 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014737584 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491061+0000", 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0567000000000004e-05 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.480090+0000", 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.356617993, 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012901797, 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.888 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480090+0000", 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480090+0000", 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.889 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480092+0000", 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6959999999999999e-06 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480146+0000", 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4131000000000001e-05 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480179+0000", 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2842999999999997e-05 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480201+0000", 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2204999999999998e-05 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484567+0000", 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.004366244 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484596+0000", 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8169000000000001e-05 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492902+0000", 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0083067230000000002 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492992+0000", 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9785999999999997e-05 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.892 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:02.893 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.480426+0000", 2024-04-26T02:25:02.893 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.356282193999998, 2024-04-26T02:25:02.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012543535999999999, 2024-04-26T02:25:02.893 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.893 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.893 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.893 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480426+0000", 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480426+0000", 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480428+0000", 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.903e-06 2024-04-26T02:25:02.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480589+0000", 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016117700000000001 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480619+0000", 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0218000000000001e-05 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480642+0000", 2024-04-26T02:25:02.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2943e-05 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486346+0000", 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057037650000000004 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486370+0000", 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3626e-05 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492860+0000", 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0064904589999999996 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492970+0000", 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010944500000000001 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:655 3.0s0 3:096ef8df:::smithi17529564-7:head [append 0~589824] snapc 1c=[1c,1b,1a,19,18,13,11,10] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:47.518368+0000", 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 15.318339814, 2024-04-26T02:25:02.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018488940999999998, 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 655 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.518368+0000", 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.518368+0000", 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.518372+0000", 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2040000000000002e-06 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.519137+0000", 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00076513500000000001 2024-04-26T02:25:02.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.519160+0000", 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3295e-05 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.519175+0000", 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4711e-05 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.519322+0000", 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000147639 2024-04-26T02:25:02.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.519337+0000", 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5007e-05 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.524564+0000", 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052269710000000004 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.524699+0000", 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013436899999999999 2024-04-26T02:25:02.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.526890+0000", 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00219155 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.530927+0000", 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0040368950000000004 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.536775+0000", 2024-04-26T02:25:02.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.005847367 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.536857+0000", 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2798000000000002e-05 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.903 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:656 3.0s0 3:096ef8df:::smithi17529564-7:head [append 0~753664] snapc 1c=[1c,1b,1a,19,18,13,11,10] ondisk+write+known_if_redirected+supports_pool_eio e80)", 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:47.528587+0000", 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 15.30812117, 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013775499, 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 656 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.904 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.528587+0000", 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.528587+0000", 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.528589+0000", 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.463e-06 2024-04-26T02:25:02.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.529558+0000", 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00096968800000000002 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.529568+0000", 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.927e-06 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.529574+0000", 2024-04-26T02:25:02.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6670000000000001e-06 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.529619+0000", 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.5401999999999997e-05 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.529721+0000", 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00010161400000000001 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.530375+0000", 2024-04-26T02:25:02.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00065426299999999998 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.531438+0000", 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001063266 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.542289+0000", 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010851107 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.908 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:47.542363+0000", 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3102000000000006e-05 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s5 85/31 ECSubWrite(tid=77, reqid=osd.11.0:77, at_version=85'63, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.479333+0000", 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.357375336, 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018929898000000001, 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479333+0000", 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479333+0000", 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479334+0000", 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479389+0000", 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5192000000000003e-05 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479419+0000", 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0378999999999998e-05 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479443+0000", 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3373000000000001e-05 2024-04-26T02:25:02.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479628+0000", 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018508000000000001 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479654+0000", 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6342e-05 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.498175+0000", 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018521203999999999 2024-04-26T02:25:02.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.498263+0000", 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7620999999999993e-05 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as5 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.479538+0000", 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.357170653000001, 2024-04-26T02:25:02.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017749369000000001, 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479538+0000", 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.914 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479538+0000", 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479547+0000", 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4259999999999992e-06 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479853+0000", 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030627999999999997 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479879+0000", 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5539999999999999e-05 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479899+0000", 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0169e-05 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.480035+0000", 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000136131 2024-04-26T02:25:02.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.480059+0000", 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3949999999999999e-05 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.497197+0000", 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017138118000000001 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.497287+0000", 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9754999999999997e-05 2024-04-26T02:25:02.917 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s5 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.484713+0000", 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.351994981000001, 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018776145000000001, 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484713+0000", 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484713+0000", 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484715+0000", 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9199999999999998e-06 2024-04-26T02:25:02.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484765+0000", 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9728999999999998e-05 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484806+0000", 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1556e-05 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484830+0000", 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3983000000000001e-05 2024-04-26T02:25:02.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.485026+0000", 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019576899999999999 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.485054+0000", 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7540000000000001e-05 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503373+0000", 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018318817000000001 2024-04-26T02:25:02.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503489+0000", 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011683099999999999 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 85/31 ECSubWrite(tid=265, reqid=osd.0.0:265, at_version=85'138, trim_to=0'0, roll_forward_to=84'136))", 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.486690+0000", 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.350017750999999, 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013869509, 2024-04-26T02:25:02.922 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.486690+0000", 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.486690+0000", 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.923 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.486691+0000", 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1900000000000001e-07 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487509+0000", 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000818087 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487542+0000", 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2533000000000002e-05 2024-04-26T02:25:02.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487564+0000", 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2331999999999999e-05 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487809+0000", 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00024427800000000001 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487834+0000", 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5867000000000002e-05 2024-04-26T02:25:02.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.500478+0000", 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012643988 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.500560+0000", 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.1505e-05 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs5 85/31 ECSubWrite(tid=266, reqid=osd.0.0:266, at_version=85'68, trim_to=0'0, roll_forward_to=84'66))", 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.487901+0000", 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.348807307, 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015538418999999999, 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487901+0000", 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.927 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487901+0000", 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487902+0000", 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.457e-06 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488298+0000", 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00039585500000000002 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.928 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488324+0000", 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6016999999999998e-05 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488345+0000", 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0622e-05 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488493+0000", 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014846999999999999 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488518+0000", 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4620000000000001e-05 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503320+0000", 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014802063000000001 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503439+0000", 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011931500000000001 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.930 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs3 85/31 ECSubWrite(tid=267, reqid=osd.0.0:267, at_version=85'140, trim_to=0'0, roll_forward_to=84'136))", 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.488594+0000", 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.348113917999999, 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015026746000000001, 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488594+0000", 2024-04-26T02:25:02.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488594+0000", 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488596+0000", 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2300000000000001e-06 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.932 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488651+0000", 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5118999999999999e-05 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488714+0000", 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.3669000000000003e-05 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488741+0000", 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6333e-05 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.494558+0000", 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058171489999999998 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.494583+0000", 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5383000000000001e-05 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503553+0000", 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0089701409999999992 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503621+0000", 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7722e-05 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s2 85/31 ECSubWrite(tid=259, reqid=osd.6.0:259, at_version=85'86, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.491835+0000", 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.344873148, 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011916105, 2024-04-26T02:25:02.935 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.491835+0000", 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.491835+0000", 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.491836+0000", 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.491894+0000", 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8232000000000001e-05 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.491925+0000", 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1189000000000002e-05 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.491951+0000", 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5316e-05 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.492206+0000", 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025541499999999999 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.492233+0000", 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6656e-05 2024-04-26T02:25:02.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503710+0000", 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011477431999999999 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.503751+0000", 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1158000000000001e-05 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:02.939 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:02.941 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:25:02.942 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:02.936+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:03.042 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:03.038+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:03.105 INFO:teuthology.orchestra.run.smithi142.stdout:3.fs3 2024-04-26T02:25:03.105 INFO:teuthology.orchestra.run.smithi142.stdout:3.bs6 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:3.7s4 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:3.es1 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:3.6s1 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:3.1s2 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:3.0s5 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:3.2s0 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:2.3 2024-04-26T02:25:03.106 INFO:teuthology.orchestra.run.smithi142.stdout:2.1 2024-04-26T02:25:03.112 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:25:03.112 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:03.126 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:25:03.143 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:25:03.136+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:25:03.244 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:03.244 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:03.244 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:25:03.244 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:25:03.245 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:03.245 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:03.242+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:03.258 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:25:03.347 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:03.339+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:03.383 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:25:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:25:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:25:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:25:03.383 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 57.345292901000001, 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073503989999999996, 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034871+0000", 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6700000000000001e-06 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034923+0000", 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1613000000000002e-05 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034958+0000", 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4913000000000003e-05 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034979+0000", 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1863000000000001e-05 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035130+0000", 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150018 2024-04-26T02:25:03.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035154+0000", 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4615999999999999e-05 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042120+0000", 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069656709999999997 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042220+0000", 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100035 2024-04-26T02:25:03.387 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.389 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.389 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 57.322133485000002, 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066527089999999997, 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:25:03.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058037+0000", 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2330000000000006e-06 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058090+0000", 2024-04-26T02:25:03.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2769999999999998e-05 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058122+0000", 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2224999999999997e-05 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058146+0000", 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3924e-05 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058303+0000", 2024-04-26T02:25:03.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000157078 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058328+0000", 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4485999999999999e-05 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064575+0000", 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062476040000000004 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064682+0000", 2024-04-26T02:25:03.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000106389 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.813298515, 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085029419999999994, 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.394 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566865+0000", 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.023e-06 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566916+0000", 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1465999999999998e-05 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566933+0000", 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6786000000000002e-05 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566944+0000", 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0907000000000001e-05 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569079+0000", 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021353470000000001 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569114+0000", 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4693000000000001e-05 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575260+0000", 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061455479999999998 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575367+0000", 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000107172 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.811012505999997, 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062937890000000002, 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.398 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569150+0000", 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1999999999999999e-07 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569197+0000", 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6388999999999999e-05 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569225+0000", 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7852999999999999e-05 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569246+0000", 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0826999999999999e-05 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569426+0000", 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018082100000000001 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569452+0000", 2024-04-26T02:25:03.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5993e-05 2024-04-26T02:25:03.402 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575302+0000", 2024-04-26T02:25:03.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0058498880000000001 2024-04-26T02:25:03.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575444+0000", 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014139799999999999 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.572514+0000", 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.807648669000002, 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062169570000000004, 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.404 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572514+0000", 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572514+0000", 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572516+0000", 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9700000000000002e-06 2024-04-26T02:25:03.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572568+0000", 2024-04-26T02:25:03.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1932999999999999e-05 2024-04-26T02:25:03.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.407 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572599+0000", 2024-04-26T02:25:03.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1146000000000003e-05 2024-04-26T02:25:03.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572620+0000", 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1625999999999999e-05 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572874+0000", 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025394099999999999 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572899+0000", 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4862999999999999e-05 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578658+0000", 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0057588090000000002 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578731+0000", 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.2669000000000005e-05 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:25:03.409 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.572658+0000", 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.807504621, 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061130250000000002, 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572658+0000", 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572658+0000", 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572659+0000", 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.68e-06 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572714+0000", 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4756000000000002e-05 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572749+0000", 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5139999999999999e-05 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.572771+0000", 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1716999999999999e-05 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.412 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573132+0000", 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00036077199999999998 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573157+0000", 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5279999999999999e-05 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578545+0000", 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0053882560000000001 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578771+0000", 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000225424 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.806609770000001, 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082705049999999992, 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.414 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:03.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573606+0000", 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602999999999998e-05 2024-04-26T02:25:03.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573635+0000", 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8873e-05 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573660+0000", 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4828999999999999e-05 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575052+0000", 2024-04-26T02:25:03.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013921319999999999 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575077+0000", 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5265999999999998e-05 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581726+0000", 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066491959999999996 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581823+0000", 2024-04-26T02:25:03.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6825999999999998e-05 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 36.801469509, 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072766089999999999, 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578694+0000", 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6670000000000001e-06 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578777+0000", 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2946000000000002e-05 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578804+0000", 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6642999999999999e-05 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578824+0000", 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9962999999999998e-05 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578977+0000", 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015333799999999999 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579002+0000", 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4490000000000001e-05 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585878+0000", 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006876137 2024-04-26T02:25:03.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585969+0000", 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1425e-05 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.904292611999999, 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0078231570000000007, 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.423 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.424 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1699999999999997e-07 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475917+0000", 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6984999999999998e-05 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475950+0000", 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2175000000000003e-05 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475973+0000", 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3822e-05 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476141+0000", 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000168073 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476167+0000", 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5069e-05 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483535+0000", 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073683589999999997 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483693+0000", 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015795699999999999 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:25:03.427 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.904127112000001, 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085944239999999998, 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476036+0000", 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7699999999999992e-07 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476086+0000", 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0274e-05 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476109+0000", 2024-04-26T02:25:03.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2123000000000001e-05 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476125+0000", 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6804999999999999e-05 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478426+0000", 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002300814 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478460+0000", 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3671999999999999e-05 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484563+0000", 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006102639 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484630+0000", 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7119999999999994e-05 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.903845446999998, 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007423453, 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7000000000000005e-07 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476366+0000", 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9001000000000001e-05 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476390+0000", 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3181999999999999e-05 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476410+0000", 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0179000000000001e-05 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476565+0000", 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000155558 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476591+0000", 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5752e-05 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483658+0000", 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0070671969999999999 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483740+0000", 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2014000000000005e-05 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.903117996999999, 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074208959999999997, 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.436 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477046+0000", 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7689999999999999e-06 2024-04-26T02:25:03.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477094+0000", 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7948000000000002e-05 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477127+0000", 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3052000000000001e-05 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477149+0000", 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2198999999999999e-05 2024-04-26T02:25:03.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478668+0000", 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015185140000000001 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478692+0000", 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4155000000000002e-05 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484377+0000", 2024-04-26T02:25:03.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056854990000000001 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484465+0000", 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.776e-05 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 66/31 ECSubWrite(tid=74, reqid=osd.8.0:74, at_version=66'53, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.896586864, 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092472439999999999, 2024-04-26T02:25:03.440 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483576+0000", 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7400000000000003e-07 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483698+0000", 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122371 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483731+0000", 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2404999999999999e-05 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483769+0000", 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7866e-05 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484007+0000", 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00023789300000000001 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484030+0000", 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3836e-05 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492725+0000", 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086945890000000008 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492823+0000", 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7709999999999998e-05 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 66/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=66'22, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:25:03.444 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 29.896399542000001, 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0090347959999999995, 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:25:03.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483765+0000", 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7770000000000001e-06 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483820+0000", 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5084000000000003e-05 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483844+0000", 2024-04-26T02:25:03.446 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4788999999999999e-05 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483868+0000", 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3339000000000001e-05 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484151+0000", 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028312500000000001 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484176+0000", 2024-04-26T02:25:03.447 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4783e-05 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492704+0000", 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085281000000000003 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492798+0000", 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3799000000000001e-05 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.448 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 75/31 ECSubWrite(tid=51, reqid=osd.14.0:51, at_version=75'48, trim_to=0'0, roll_forward_to=74'46))", 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.906797919999999, 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006684471, 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.449 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473365+0000", 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9999999999999997e-07 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473427+0000", 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1585000000000001e-05 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.450 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473459+0000", 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473487+0000", 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8306e-05 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473645+0000", 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015791500000000001 2024-04-26T02:25:03.451 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473673+0000", 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7690000000000001e-05 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.479974+0000", 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063010180000000002 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.480049+0000", 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5020999999999999e-05 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.452 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 75/31 ECSubWrite(tid=52, reqid=osd.14.0:52, at_version=75'50, trim_to=0'0, roll_forward_to=74'46))", 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:42.476285+0000", 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 20.903876828000001, 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006039249, 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.453 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476285+0000", 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476285+0000", 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476287+0000", 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.874e-06 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.454 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476340+0000", 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2895000000000001e-05 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476394+0000", 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3392e-05 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476417+0000", 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3506000000000002e-05 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476581+0000", 2024-04-26T02:25:03.455 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016345199999999999 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.476607+0000", 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6703000000000002e-05 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.482232+0000", 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056241859999999998 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.456 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.482325+0000", 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3240999999999997e-05 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 90/31 ECSubWrite(tid=295, reqid=client.4589.0:741, at_version=90'70, trim_to=0'0, roll_forward_to=85'68))", 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:57.510420+0000", 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 5.8697420810000001, 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060258550000000001, 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.457 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510420+0000", 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510420+0000", 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510421+0000", 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.116e-06 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.458 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510648+0000", 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000226636 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510684+0000", 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6128999999999999e-05 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.459 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510710+0000", 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5950000000000001e-05 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510911+0000", 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020065600000000001 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.510938+0000", 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7725999999999998e-05 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.460 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.516353+0000", 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054145340000000004 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:57.516446+0000", 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3108000000000004e-05 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 91/31 ECSubWrite(tid=306, reqid=client.4589.0:757, at_version=91'80, trim_to=0'0, roll_forward_to=90'76))", 2024-04-26T02:25:03.461 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:58.617332+0000", 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.7628308109999997, 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059751750000000001, 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.617332+0000", 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.617332+0000", 2024-04-26T02:25:03.462 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.617333+0000", 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4729999999999999e-06 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.617374+0000", 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1452999999999998e-05 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.617403+0000", 2024-04-26T02:25:03.463 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8915999999999999e-05 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.617425+0000", 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1880000000000001e-05 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.619102+0000", 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001676575 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.619129+0000", 2024-04-26T02:25:03.464 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7175999999999999e-05 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.623206+0000", 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0040766409999999998 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:58.623307+0000", 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000101061 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.465 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 92/31 ECSubWrite(tid=310, reqid=osd.0.0:310, at_version=92'84, trim_to=0'0, roll_forward_to=91'82))", 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.627604+0000", 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 3.7525586799999999, 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061581880000000002, 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627604+0000", 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.466 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627604+0000", 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627604+0000", 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5999999999999999e-07 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627655+0000", 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0553000000000002e-05 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.467 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627685+0000", 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0171999999999998e-05 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627707+0000", 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2439999999999999e-05 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628386+0000", 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00067891700000000002 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.468 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628417+0000", 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0725999999999997e-05 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.633666+0000", 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0052492320000000004 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.633762+0000", 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5787999999999998e-05 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.469 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 92/31 ECSubWrite(tid=311, reqid=osd.0.0:311, at_version=92'86, trim_to=0'0, roll_forward_to=91'82))", 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.630879+0000", 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 3.7492833980000002, 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060277739999999996, 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630879+0000", 2024-04-26T02:25:03.470 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630879+0000", 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.471 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630882+0000", 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5959999999999998e-06 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630933+0000", 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1969000000000003e-05 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630966+0000", 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2589999999999998e-05 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.472 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630989+0000", 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3178999999999999e-05 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.631145+0000", 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015613399999999999 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.631172+0000", 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6876000000000002e-05 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.636802+0000", 2024-04-26T02:25:03.473 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056299990000000001 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.636907+0000", 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104431 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.474 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:03.476 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:25:03.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:25:03.477 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:03.468+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:329: done (4 left) 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:330: done (3 left) 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:331: done (2 left) 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:332: done (1 left) 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:333: read oid 29 snap 23 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:333: expect deleted 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:334: copy_from oid 5 from oid 45 current snap is 35 2024-04-26T02:25:03.485 INFO:tasks.rados.rados.0.smithi175.stdout:335: snap_create 2024-04-26T02:25:03.509 INFO:tasks.rados.rados.0.smithi175.stdout:327: finishing write tid 1 to smithi17529564-6 2024-04-26T02:25:03.511 INFO:tasks.rados.rados.0.smithi175.stdout:327: finishing write tid 2 to smithi17529564-6 2024-04-26T02:25:03.511 INFO:tasks.rados.rados.0.smithi175.stdout:334: finishing copy_from racing read to smithi17529564-5 2024-04-26T02:25:03.512 INFO:tasks.rados.rados.0.smithi175.stdout:334: finishing copy_from to smithi17529564-5 2024-04-26T02:25:03.513 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 5 v 4 (ObjNum 32 snap 0 seq_num 32) dirty exists 2024-04-26T02:25:03.514 INFO:tasks.rados.rados.0.smithi175.stdout:327: finishing write tid 3 to smithi17529564-6 2024-04-26T02:25:03.514 INFO:tasks.rados.rados.0.smithi175.stdout:327: oid 6 updating version 0 to 68 2024-04-26T02:25:03.514 INFO:tasks.rados.rados.0.smithi175.stdout:327: oid 6 version 68 is already newer than 67 2024-04-26T02:25:03.514 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 6 v 68 (ObjNum 144 snap 34 seq_num 144) dirty exists 2024-04-26T02:25:03.514 INFO:tasks.rados.rados.0.smithi175.stdout:327: left oid 6 (ObjNum 144 snap 34 seq_num 144) 2024-04-26T02:25:03.577 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:03.576+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:03.651 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:03.651 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:03.651 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:25:03.651 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:03.653 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-14 --journal-path /var/lib/ceph/osd/ceph-14/journal --op export --pgid 3.6s1 --file /var/log/ceph/exp.3.6s1.14 2024-04-26T02:25:03.666 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:25:03.711 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:25:03.707+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:25:03.779 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:03.775+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:03.785 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:03.785 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:03.785 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:25:03.785 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:25:03.785 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:03.799 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:25:03.880 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:03.875+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 58.92264832, 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010661271, 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.966 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.967 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041762+0000", 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.44e-07 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041818+0000", 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6208999999999997e-05 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041850+0000", 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.968 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041876+0000", 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5426999999999999e-05 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042091+0000", 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021539399999999999 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042116+0000", 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4403e-05 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.969 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052304+0000", 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010188236999999999 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052423+0000", 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011882100000000001 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:25:03.970 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 58.922460891999997, 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012114710000000001, 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:25:03.971 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041950+0000", 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041995+0000", 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4988999999999999e-05 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042019+0000", 2024-04-26T02:25:03.972 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4712999999999999e-05 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042038+0000", 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045071+0000", 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003033015 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045096+0000", 2024-04-26T02:25:03.973 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4607e-05 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053959+0000", 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088630800000000006 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054064+0000", 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104576 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.974 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.494363158999999, 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017047870999999999, 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.975 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470048+0000", 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.083e-06 2024-04-26T02:25:03.976 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470109+0000", 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1620999999999998e-05 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470135+0000", 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5344999999999999e-05 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470154+0000", 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9836000000000001e-05 2024-04-26T02:25:03.977 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472084+0000", 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001929343 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472117+0000", 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3411999999999998e-05 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486997+0000", 2024-04-26T02:25:03.978 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014879618000000001 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.487094+0000", 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7613000000000002e-05 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=201, reqid=osd.0.0:201, at_version=66'104, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.488081957999999, 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012116203000000001, 2024-04-26T02:25:03.979 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.980 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476376+0000", 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7428000000000001e-05 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.981 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476400+0000", 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4258999999999999e-05 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476420+0000", 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9656e-05 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476577+0000", 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015684299999999999 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.982 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476602+0000", 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5752e-05 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488347+0000", 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011744378999999999 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488444+0000", 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7195999999999996e-05 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.983 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.484595247000001, 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010307349, 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.984 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:25:03.985 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479816+0000", 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479872+0000", 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6118e-05 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.986 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479901+0000", 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9000999999999999e-05 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479922+0000", 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1002999999999999e-05 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.987 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480270+0000", 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034741900000000002 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480293+0000", 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3592e-05 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490051+0000", 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097579220000000005 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.988 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490122+0000", 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0541000000000001e-05 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 66/31 ECSubWrite(tid=52, reqid=osd.11.0:52, at_version=66'38, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.472742216, 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014479226, 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.989 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491668+0000", 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.990 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491726+0000", 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8114e-05 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491758+0000", 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1708999999999997e-05 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491781+0000", 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3102e-05 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.991 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491988+0000", 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020686399999999999 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492015+0000", 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6565999999999999e-05 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506059+0000", 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014044401999999999 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.992 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506147+0000", 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7762000000000004e-05 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 66/31 ECSubWrite(tid=89, reqid=osd.13.0:89, at_version=66'42, trim_to=0'0, roll_forward_to=65'38))", 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.471863456000001, 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013675405999999999, 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.993 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.994 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492548+0000", 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7099999999999999e-06 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492635+0000", 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6942999999999997e-05 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493144+0000", 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00050879899999999999 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.995 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493171+0000", 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7075000000000001e-05 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493329+0000", 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015824 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.996 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493353+0000", 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4212000000000001e-05 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506165+0000", 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012812161000000001 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.997 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506222+0000", 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6266e-05 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 66/31 ECSubWrite(tid=90, reqid=osd.13.0:87, at_version=0'0, trim_to=0'0, roll_forward_to=66'26))", 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.470835712, 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012679335999999999, 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:03.998 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:03.999 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493576+0000", 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8899999999999999e-06 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493604+0000", 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7691999999999998e-05 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493653+0000", 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9407999999999999e-05 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.000 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493678+0000", 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4966000000000001e-05 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493892+0000", 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000214494 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493917+0000", 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4229000000000001e-05 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.001 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506175+0000", 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012258290999999999 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506253+0000", 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8366000000000002e-05 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.470655019999999, 2024-04-26T02:25:04.002 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015128608, 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.003 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493756+0000", 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493809+0000", 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2507999999999999e-05 2024-04-26T02:25:04.005 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493837+0000", 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8051999999999998e-05 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493863+0000", 2024-04-26T02:25:04.006 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5559e-05 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495037+0000", 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011746879999999999 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495063+0000", 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5641999999999999e-05 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508808+0000", 2024-04-26T02:25:04.007 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013744869 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508883+0000", 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5537000000000005e-05 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.470144901000001, 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012858193, 2024-04-26T02:25:04.008 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.009 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494266+0000", 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7099999999999999e-06 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494292+0000", 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5148999999999999e-05 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.010 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494322+0000", 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0052e-05 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494363+0000", 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0825000000000003e-05 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494552+0000", 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018990500000000001 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.011 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494575+0000", 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2969e-05 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.507077+0000", 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012501134000000001 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.507123+0000", 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6449000000000002e-05 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.012 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=205, reqid=osd.0.0:205, at_version=66'108, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.468771667999999, 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013207474, 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:25:04.013 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495640+0000", 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.79e-06 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495692+0000", 2024-04-26T02:25:04.014 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2676999999999997e-05 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495733+0000", 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0098999999999997e-05 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495756+0000", 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3289e-05 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495971+0000", 2024-04-26T02:25:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021559699999999999 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495996+0000", 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4975999999999999e-05 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.016 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508761+0000", 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012764538000000001 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508845+0000", 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4507999999999998e-05 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=206, reqid=osd.0.0:206, at_version=66'110, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:25:04.017 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 30.467651288999999, 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016729174999999999, 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.018 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496760+0000", 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0940000000000002e-06 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496810+0000", 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9588e-05 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496842+0000", 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1780999999999999e-05 2024-04-26T02:25:04.019 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496864+0000", 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.23e-05 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506108+0000", 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092442960000000008 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506124+0000", 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5327000000000001e-05 2024-04-26T02:25:04.020 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.513404+0000", 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072804300000000001 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.513488+0000", 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3358999999999999e-05 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.021 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 85/31 ECSubWrite(tid=197, reqid=osd.12.0:197, at_version=85'95, trim_to=0'0, roll_forward_to=83'91))", 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.476366+0000", 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.488043897000001, 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0099852940000000005, 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476366+0000", 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.022 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476366+0000", 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476367+0000", 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5999999999999991e-07 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476408+0000", 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1588999999999998e-05 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.023 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476433+0000", 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4842999999999999e-05 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476452+0000", 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8403e-05 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.478686+0000", 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022340400000000001 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.024 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.478712+0000", 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.597e-05 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.486258+0000", 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075463170000000003 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.486351+0000", 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3171999999999995e-05 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.025 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 85/31 ECSubWrite(tid=267, reqid=osd.0.0:267, at_version=85'140, trim_to=0'0, roll_forward_to=84'136))", 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.484715+0000", 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 11.47969509, 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011963942999999999, 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484715+0000", 2024-04-26T02:25:04.026 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484715+0000", 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.027 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484716+0000", 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484765+0000", 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8999000000000003e-05 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484791+0000", 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5922999999999999e-05 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.028 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484812+0000", 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0945999999999999e-05 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.489571+0000", 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047585320000000002 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.489597+0000", 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6316e-05 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.029 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.496595+0000", 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069977850000000003 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.496679+0000", 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3922000000000001e-05 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=309, reqid=client.4589.0:769, at_version=92'163, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:04.030 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.3364239339999999, 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010634701, 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.031 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.3e-07 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628578+0000", 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000592002 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628625+0000", 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6808999999999999e-05 2024-04-26T02:25:04.032 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628650+0000", 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4573e-05 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628860+0000", 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021052199999999999 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628888+0000", 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8007000000000001e-05 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.033 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.638536+0000", 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0096479159999999994 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.638620+0000", 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4241999999999997e-05 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.034 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=312, reqid=osd.0.0:312, at_version=92'165, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.629743+0000", 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.3346663909999998, 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012450954, 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629743+0000", 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.035 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629743+0000", 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629745+0000", 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.767e-06 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629797+0000", 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2034999999999999e-05 2024-04-26T02:25:04.036 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629829+0000", 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2166999999999999e-05 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629854+0000", 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5185999999999999e-05 2024-04-26T02:25:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630436+0000", 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00058201900000000003 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630528+0000", 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1185000000000002e-05 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642097+0000", 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011569322999999999 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642194+0000", 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7272e-05 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.039 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=313, reqid=osd.0.0:313, at_version=92'167, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.630702+0000", 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.3337079489999999, 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011648366, 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.041 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630702+0000", 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630702+0000", 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630703+0000", 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.042 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630754+0000", 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0989000000000003e-05 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630784+0000", 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9366999999999999e-05 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630809+0000", 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5452e-05 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.043 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.631492+0000", 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068237799999999998 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.631516+0000", 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4419000000000001e-05 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642207+0000", 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010690804 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.044 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642350+0000", 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014320399999999999 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=314, reqid=client.4589.0:770, at_version=92'168, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.637048+0000", 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.3273615410000001, 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011100059000000001, 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.045 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637048+0000", 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637048+0000", 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.046 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637050+0000", 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6199999999999999e-06 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637391+0000", 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034114099999999999 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637424+0000", 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3535999999999999e-05 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.047 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637447+0000", 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2782999999999999e-05 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.639043+0000", 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00159553 2024-04-26T02:25:04.048 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.053 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.053 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.053 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.639069+0000", 2024-04-26T02:25:04.053 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6282999999999999e-05 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.648054+0000", 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0089850180000000009 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.648148+0000", 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4147999999999994e-05 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.054 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 95/31 ECSubWrite(tid=167, reqid=osd.13.0:167, at_version=95'58, trim_to=0'0, roll_forward_to=93'56))", 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:02.478389+0000", 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.4860205470000001, 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010729288, 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.055 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478389+0000", 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478389+0000", 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478390+0000", 2024-04-26T02:25:04.056 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1710000000000001e-06 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478426+0000", 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5386000000000003e-05 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.057 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478441+0000", 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5670000000000001e-05 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478454+0000", 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2833000000000001e-05 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478708+0000", 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025374499999999999 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.058 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478739+0000", 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1016000000000003e-05 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.489072+0000", 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010332604 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.489118+0000", 2024-04-26T02:25:04.059 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6863000000000002e-05 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 95/31 ECSubWrite(tid=168, reqid=osd.13.0:168, at_version=95'60, trim_to=0'0, roll_forward_to=93'56))", 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:02.479940+0000", 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.484469563, 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011676845999999999, 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.060 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479940+0000", 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479940+0000", 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479941+0000", 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6400000000000001e-07 2024-04-26T02:25:04.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479966+0000", 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5199e-05 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479980+0000", 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3732e-05 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479990+0000", 2024-04-26T02:25:04.062 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7890000000000006e-06 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.480896+0000", 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00090580200000000004 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.480909+0000", 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3407000000000001e-05 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.491569+0000", 2024-04-26T02:25:04.063 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010660484 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.491617+0000", 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7568999999999998e-05 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.064 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:04.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:25:04.067 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:04.063+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:04.167 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:04.162+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:04.237 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:04.237 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:04.237 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:25:04.237 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:04.251 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:25:04.270 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:04.262+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:04.370 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:04.363+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:04.373 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:04.373 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:04.373 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:25:04.373 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:25:04.373 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:04.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:25:04.470 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:04.466+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:04.486 INFO:tasks.rados.rados.0.smithi175.stdout:327: done (3 left) 2024-04-26T02:25:04.486 INFO:tasks.rados.rados.0.smithi175.stdout:333: done (2 left) 2024-04-26T02:25:04.486 INFO:tasks.rados.rados.0.smithi175.stdout:334: done (1 left) 2024-04-26T02:25:04.486 INFO:tasks.rados.rados.0.smithi175.stdout:335: done (0 left) 2024-04-26T02:25:04.486 INFO:tasks.rados.rados.0.smithi175.stdout:336: snap_remove snap 27 2024-04-26T02:25:04.509 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:203 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 58.473071543000003, 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017435761000000001, 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:04.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 203 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.511 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033119+0000", 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1899999999999997e-06 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033136+0000", 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7200000000000001e-05 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.512 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033176+0000", 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9603e-05 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033196+0000", 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0492999999999998e-05 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033371+0000", 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000174864 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.513 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033394+0000", 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043073+0000", 2024-04-26T02:25:04.514 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0096797610000000003 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043333+0000", 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000259602 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.515 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050550+0000", 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072173649999999999 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:204 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 58.472940921000003, 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019331481000000001, 2024-04-26T02:25:04.516 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 204 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.517 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033247+0000", 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0870000000000001e-06 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.518 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033257+0000", 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8859999999999999e-06 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033277+0000", 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0213000000000001e-05 2024-04-26T02:25:04.519 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033292+0000", 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4503e-05 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033585+0000", 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029350600000000002 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.520 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033603+0000", 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7706999999999998e-05 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044154+0000", 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010550888 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044306+0000", 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000152258 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.521 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.052577+0000", 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082704330000000006 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:205 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 58.472863898999996, 2024-04-26T02:25:04.522 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020334097999999998, 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 205 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.523 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033324+0000", 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.297e-06 2024-04-26T02:25:04.524 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033333+0000", 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2730000000000008e-06 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033352+0000", 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8768999999999999e-05 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033369+0000", 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7703999999999999e-05 2024-04-26T02:25:04.525 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033691+0000", 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032162500000000003 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033707+0000", 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6135999999999999e-05 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.526 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047742+0000", 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014034835000000001 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.048005+0000", 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026275300000000001 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053656+0000", 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056517060000000003 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.527 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 31.035807995999999, 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019654082999999999, 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:25:04.528 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470380+0000", 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5370000000000001e-06 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.529 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470428+0000", 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8084999999999998e-05 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470454+0000", 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6611999999999999e-05 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470474+0000", 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9969000000000001e-05 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.530 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472365+0000", 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001890978 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472393+0000", 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7518999999999999e-05 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.489955+0000", 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017561729000000002 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.531 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490032+0000", 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7653999999999999e-05 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 31.030585120000001, 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021524287, 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.532 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475603+0000", 2024-04-26T02:25:04.533 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0260000000000002e-06 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475695+0000", 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1749999999999994e-05 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475731+0000", 2024-04-26T02:25:04.534 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6205000000000003e-05 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475753+0000", 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1903e-05 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483278+0000", 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075251349999999996 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.535 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483299+0000", 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0865000000000001e-05 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497045+0000", 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013746466000000001 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497125+0000", 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9937000000000004e-05 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.536 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s6 66/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=66'22, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.485176+0000", 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 31.021009997, 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016761895999999998, 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.537 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485176+0000", 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485176+0000", 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485178+0000", 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1069999999999999e-06 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.538 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485241+0000", 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2210000000000002e-05 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485275+0000", 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4829000000000001e-05 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.485298+0000", 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2838999999999999e-05 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.539 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490440+0000", 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0051415819999999996 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490464+0000", 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4579e-05 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.501854+0000", 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011389720000000001 2024-04-26T02:25:04.540 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.501938+0000", 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4029999999999993e-05 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:568 3.9s0 3:998d036b:::smithi17529564-5:head [create,setxattr QRSjfcoZhRVnicS[eSPbUc^qrRbNaYScYbZhaamS (1543) in=40b,setxattr Zjrh`qflgPeZldqmsbbVQnalaXbP[b^fsSploSoT (1295) in=40b,setxattr jP`iT\\QlgssrW_ioUenT[sqaW_soZloqTY`i[fdt (1614) in=40b,setxattr SRRc_re`acb]l\\hiakiqT`Z[isftYagZgp^jjTpO (631) in=40b,setxattr ^RSUl^WUXfaRQU]UYNkYZPilQtYXObeOajNUp`^g (1330) in=40b,setxattr othroUQfhqiX`QOWcQN[mahld[dpocs]\\NNqRSbs (1330) in=40b,setxattr o_ngaOZpXtWoqkaf\\gtRU`]eibg]NedssXjSdVio (631) in=40b,setxattr ^^[OYTcRcbV^X^YZXUd[aUhcdnNYtNgXUfqnaaVR (12980) in=40b,setxattr ekmQRY`lpYsdsPOhhcWUrfrfd]gg\\Y\\VdoSSalnV (70) in=40b,setxattr [ie^NP]erYsq`p_Z]sbfVXSXVnQb^Yr\\dZOjXbad (1543) in=40b,setxattr Z]bNbNRemgjYjpNXZ_mPURYPQNOOWQmmtiVqaUca (630) in=40b,setxattr [jVY`Wq[rUN`kr[k`eq^fOUOSk (9612) in=26b,setxattr ni^VZ^jfqWaQcdQTXiWksqd]_apYpa]g\\kPdhPna (419) in=40b,setxattr _tchprYSfT_SpoXkYcVnYriaVUaom\\t_oaRn[PRT (16348) in=40b,setxattr iSNpZnkoptgrQh_Q[dZah\\WlbjqcP\\aO\\\\Ri]Qeh (10804) in=40b,setxattr q\\WNZWjtm_cR``UmY[sWXRemrptfWmf_SZrOgSYY (7228) in=40b,setxattr UoQsk_NkliWsPpkcptQf\\hclfhVnfNjc]qmkkRaO (102) in=40b,setxattr kkhT]jar]PlaVo]lp (9612) in=17b,setxattr cpPdqsOmpSSPOQWQpgi\\\\cmoRWlSfjYeseZacaOs (698) in=40b,setxattr ssPWdiWi[TVTilZ\\TkcllpdTOZemamorRUtUWY__ (14664) in=40b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.929975221999999, 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022811324000000001, 2024-04-26T02:25:04.541 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 568 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.542 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576215+0000", 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7139999999999999e-06 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576730+0000", 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000515238 2024-04-26T02:25:04.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576792+0000", 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2111000000000002e-05 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576817+0000", 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4579e-05 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576985+0000", 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000168049 2024-04-26T02:25:04.544 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.577007+0000", 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2143000000000001e-05 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.585039+0000", 2024-04-26T02:25:04.545 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080317189999999997 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.585473+0000", 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000434597 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589160+0000", 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0036868180000000001 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595161+0000", 2024-04-26T02:25:04.546 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060015049999999999 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.598839+0000", 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00367717 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.599022+0000", 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018368099999999999 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.547 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:574 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~786432] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.919604177, 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024397418000000001, 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 574 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.548 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586586+0000", 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.76e-06 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.549 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588621+0000", 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020356419999999998 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588663+0000", 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1369000000000003e-05 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588686+0000", 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2702e-05 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.550 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589399+0000", 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071377599999999995 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589701+0000", 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000301682 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.593275+0000", 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035744739999999998 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.551 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.605907+0000", 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012632012999999999 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.610815+0000", 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049077330000000001 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.610979+0000", 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000164267 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.552 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:575 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~458752] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.915245379000002, 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020767264000000001, 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 575 2024-04-26T02:25:04.553 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.554 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590950+0000", 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9870000000000005e-06 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592071+0000", 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001121241 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592102+0000", 2024-04-26T02:25:04.555 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1131999999999999e-05 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592121+0000", 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.914e-05 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595884+0000", 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037628990000000001 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596158+0000", 2024-04-26T02:25:04.556 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027422500000000001 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.598383+0000", 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022244959999999999 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.606145+0000", 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077616789999999996 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611605+0000", 2024-04-26T02:25:04.557 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054602510000000002 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611708+0000", 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103214 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:576 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~442368] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.595542+0000", 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.91064407, 2024-04-26T02:25:04.558 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016866486999999999, 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 576 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595542+0000", 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.559 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595542+0000", 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595559+0000", 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6526000000000001e-05 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596608+0000", 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0010493130000000001 2024-04-26T02:25:04.560 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596663+0000", 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4620999999999998e-05 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596685+0000", 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2374e-05 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.600627+0000", 2024-04-26T02:25:04.561 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0039423920000000003 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.600907+0000", 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027913900000000003 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.603012+0000", 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021058800000000001 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.562 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611291+0000", 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082784680000000006 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.612207+0000", 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00091617100000000002 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.612409+0000", 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020160299999999999 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.563 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:577 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~262144] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.596768+0000", 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.909418008999999, 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016473086000000001, 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 577 2024-04-26T02:25:04.564 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596768+0000", 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596768+0000", 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.565 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596771+0000", 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.576e-06 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597070+0000", 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029942499999999997 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597096+0000", 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6152999999999998e-05 2024-04-26T02:25:04.566 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597117+0000", 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0288999999999998e-05 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.607148+0000", 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010031139 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.567 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.607452+0000", 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030462799999999998 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.609717+0000", 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002265001 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611968+0000", 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022506959999999999 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.568 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.613083+0000", 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011144060000000001 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.613241+0000", 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015877299999999999 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:578 3.es0 3:7bb6d44f:::smithi17529564-19:head [setxattr _header (57) in=7b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:25:04.569 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.909039357000001, 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022171715000000002, 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 578 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:25:04.570 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597149+0000", 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7269999999999999e-06 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597157+0000", 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7299999999999994e-06 2024-04-26T02:25:04.571 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597177+0000", 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9845999999999999e-05 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597199+0000", 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1342999999999999e-05 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.614157+0000", 2024-04-26T02:25:04.572 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016958498999999998 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.614316+0000", 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015892900000000001 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.615305+0000", 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00098857200000000006 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.573 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.617759+0000", 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024546590000000001 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619160+0000", 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001400517 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.574 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619319+0000", 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015889300000000001 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:579 3.es0 3:7bb6d44f:::smithi17529564-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.908966882000001, 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.025841363999999999, 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.575 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 579 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.576 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597221+0000", 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5859999999999999e-06 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597227+0000", 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2600000000000002e-06 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597248+0000", 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0375999999999999e-05 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.577 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597263+0000", 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.502e-05 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.616185+0000", 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018922305 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.616447+0000", 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026167300000000003 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.578 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619961+0000", 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035144899999999999 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.620208+0000", 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00024693300000000002 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.623061+0000", 2024-04-26T02:25:04.579 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028527209999999999 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:634 3.9s0 3:998264a7:::smithi17529564-45:head [copy-from ver 4] snapc 18=[18,13,11,10] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.031935254, 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024170558000000002, 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.580 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 634 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.581 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474254+0000", 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2990000000000001e-06 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474270+0000", 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5486e-05 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474306+0000", 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6508999999999999e-05 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.582 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474323+0000", 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7096999999999999e-05 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474491+0000", 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016797599999999999 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474514+0000", 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2308999999999999e-05 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.583 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478081+0000", 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035677980000000001 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478236+0000", 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015410900000000001 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.494212+0000", 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015976898999999999 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.584 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496990+0000", 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0027779060000000001 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.498291+0000", 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013005130000000001 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.498422+0000", 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013065700000000001 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.585 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:635 3.9s0 3:998264a7:::smithi17529564-45:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 21.031827676999999, 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022215378000000001, 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 635 2024-04-26T02:25:04.586 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.587 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474360+0000", 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474366+0000", 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.584e-06 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.588 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474381+0000", 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4446e-05 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474389+0000", 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7560000000000005e-06 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474652+0000", 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026254000000000002 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:04.589 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474663+0000", 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1382999999999999e-05 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478547+0000", 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038833000000000001 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478633+0000", 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6761000000000005e-05 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.590 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496261+0000", 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017627779999999999 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496403+0000", 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000141843 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496574+0000", 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000170989 2024-04-26T02:25:04.591 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.479293+0000", 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.026892816, 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018478663999999999, 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.592 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479293+0000", 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479293+0000", 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479295+0000", 2024-04-26T02:25:04.593 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9530000000000002e-06 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479525+0000", 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022994199999999999 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483009+0000", 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034832209999999999 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.594 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483036+0000", 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7143000000000001e-05 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483572+0000", 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00053610500000000005 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483597+0000", 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4813000000000001e-05 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.595 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.497689+0000", 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014092019000000001 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.497772+0000", 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3467999999999994e-05 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 85/31 ECSubWrite(tid=266, reqid=osd.0.0:266, at_version=85'68, trim_to=0'0, roll_forward_to=84'66))", 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.487685+0000", 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 12.018500867, 2024-04-26T02:25:04.596 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019861462, 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487685+0000", 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487685+0000", 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487686+0000", 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6700000000000003e-07 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487738+0000", 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2159e-05 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487765+0000", 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6806000000000001e-05 2024-04-26T02:25:04.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487787+0000", 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1976000000000001e-05 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488482+0000", 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00069517899999999998 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488511+0000", 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8546000000000001e-05 2024-04-26T02:25:04.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.507484+0000", 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018973016999999998 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.507547+0000", 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.3112000000000002e-05 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.600 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:790 3.es0 3:7bb6d44f:::smithi17529564-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.8072706280000004, 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017333788999999999, 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 790 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.601 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6700000000000002e-07 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.602 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698920+0000", 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0400000000000003e-06 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698932+0000", 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.131e-05 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698939+0000", 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6690000000000006e-06 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.603 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.713695+0000", 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014755897 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.713972+0000", 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027666499999999999 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.716249+0000", 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002277341 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.604 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:831 3.9s0 3:998d036b:::smithi17529564-5:head [copy-from ver 4] snapc 24=[24,23,22,21,1f,1d,19,10] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:03.485905+0000", 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.020280756, 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027351522999999999, 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:04.605 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 831 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485905+0000", 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485905+0000", 2024-04-26T02:25:04.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485907+0000", 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0090000000000002e-06 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485915+0000", 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.374e-06 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.607 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485930+0000", 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.49e-05 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485940+0000", 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0114e-05 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486019+0000", 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8961000000000005e-05 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:04.608 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486026+0000", 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5129999999999999e-06 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.490795+0000", 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047686120000000002 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.491072+0000", 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000276648 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:04.609 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.508168+0000", 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017096064000000001 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.512801+0000", 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046331690000000003 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.513109+0000", 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030839499999999999 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.610 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.513257+0000", 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014776399999999999 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:832 3.9s0 3:998d036b:::smithi17529564-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e96)", 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:03.485960+0000", 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 1.0202261509999999, 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024708424, 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:04.611 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 832 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485960+0000", 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485960+0000", 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:04.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485961+0000", 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.44e-07 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485964+0000", 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7699999999999999e-06 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485975+0000", 2024-04-26T02:25:04.613 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0703000000000001e-05 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485989+0000", 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.416e-05 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486128+0000", 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013835400000000001 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:04.614 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486147+0000", 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9406999999999999e-05 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.491572+0000", 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054251899999999999 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.491701+0000", 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000128391 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:04.615 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.510485+0000", 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018784729999999999 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.510572+0000", 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6562000000000002e-05 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.510668+0000", 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6513000000000002e-05 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.616 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.617 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:04.617 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:04.617 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:04.618 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:25:04.619 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:04.612+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:04.719 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:25:04.715+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:25:04.750 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:04.751 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:04.751 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:04.751 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:04.765 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:25:04.820 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:04.819+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:04.859 INFO:teuthology.orchestra.run.smithi142.stderr:Exporting 3.6s1 info 3.6s1( v 92'70 (0'0,92'70] local-lis/les=31/32 n=5 ec=31/31 lis/c=31/31 les/c/f=32/32/0 sis=31) 2024-04-26T02:25:04.864 INFO:teuthology.orchestra.run.smithi142.stderr:Read 1#3:638d7cd2:::smithi17529564-47:11# 2024-04-26T02:25:04.865 INFO:teuthology.orchestra.run.smithi142.stderr:Read 1#3:638d7cd2:::smithi17529564-47:head# 2024-04-26T02:25:04.867 INFO:teuthology.orchestra.run.smithi142.stderr:Read 1#3:67e91997:::smithi17529564-21:20# 2024-04-26T02:25:04.868 INFO:teuthology.orchestra.run.smithi142.stderr:Read 1#3:67e91997:::smithi17529564-21:head# 2024-04-26T02:25:04.869 INFO:teuthology.orchestra.run.smithi142.stderr:Read 1#3:687a1e37:::smithi17529564-28:head# 2024-04-26T02:25:04.871 INFO:teuthology.orchestra.run.smithi142.stderr:Export successful 2024-04-26T02:25:04.921 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:04.919+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:04.927 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:04.927 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:04.927 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:04.927 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:04.927 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:04.941 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:25:05.021 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:05.018+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:05.063 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:05.063 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:05.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:05.063 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:05.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.026652042000002, 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075357569999999997, 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033385+0000", 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4e-07 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033444+0000", 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9450999999999997e-05 2024-04-26T02:25:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033476+0000", 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1979e-05 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033497+0000", 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0616999999999999e-05 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033684+0000", 2024-04-26T02:25:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018750700000000001 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033709+0000", 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4912000000000001e-05 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040833+0000", 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071240510000000002 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040919+0000", 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6399999999999999e-05 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.025753340999998, 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010955845000000001, 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034285+0000", 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8669999999999998e-06 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034349+0000", 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4090999999999993e-05 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034386+0000", 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6511999999999999e-05 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034409+0000", 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3198999999999999e-05 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035470+0000", 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001061195 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035486+0000", 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5699999999999999e-05 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045121+0000", 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096354679999999995 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045238+0000", 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011681299999999999 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:25:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.021361360999997, 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077721719999999999, 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038675+0000", 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038732+0000", 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024999999999997e-05 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038765+0000", 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2325e-05 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038789+0000", 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4905999999999998e-05 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039037+0000", 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024744900000000001 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039062+0000", 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4719000000000002e-05 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046357+0000", 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072952980000000004 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046447+0000", 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9690000000000004e-05 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.008820315000001, 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067178699999999999, 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051217+0000", 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0099999999999998e-06 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051246+0000", 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8345999999999999e-05 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051275+0000", 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8921999999999999e-05 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051313+0000", 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7991999999999998e-05 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051640+0000", 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032731600000000002 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051665+0000", 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4729e-05 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057825+0000", 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061603889999999996 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057933+0000", 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010816599999999999 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.024887208999999, 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018386527999999999, 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035150+0000", 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9230000000000001e-06 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035236+0000", 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5860999999999997e-05 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035280+0000", 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3810999999999998e-05 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035303+0000", 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3223000000000001e-05 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035450+0000", 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014687200000000001 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035475+0000", 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4623000000000001e-05 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053426+0000", 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017950875000000002 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053535+0000", 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010933999999999999 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.018209108000001, 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012671968, 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041874+0000", 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6728999999999999e-05 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041914+0000", 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0312000000000003e-05 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041939+0000", 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4116000000000001e-05 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042110+0000", 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000171094 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042135+0000", 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.493e-05 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054408+0000", 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012273386000000001 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054499+0000", 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0650999999999997e-05 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 59.013603715999999, 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082587159999999993, 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046434+0000", 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.193e-06 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046463+0000", 2024-04-26T02:25:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046509+0000", 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6078000000000002e-05 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046565+0000", 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6048999999999998e-05 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046730+0000", 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165408 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046747+0000", 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6353000000000001e-05 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054637+0000", 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078899409999999993 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054691+0000", 2024-04-26T02:25:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4200999999999998e-05 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.501052411000003, 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014202093000000001, 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558985+0000", 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.807e-06 2024-04-26T02:25:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559023+0000", 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7985999999999998e-05 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559047+0000", 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4032999999999998e-05 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559062+0000", 2024-04-26T02:25:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5082999999999999e-05 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559703+0000", 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064080699999999997 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559728+0000", 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4851999999999999e-05 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573054+0000", 2024-04-26T02:25:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013325590999999999 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573185+0000", 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131934 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.499518191999996, 2024-04-26T02:25:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079052459999999995, 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560592+0000", 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4134999999999994e-05 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560624+0000", 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1325999999999998e-05 2024-04-26T02:25:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560647+0000", 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560875+0000", 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022790500000000001 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560900+0000", 2024-04-26T02:25:05.102 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5420000000000001e-05 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568320+0000", 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074198320000000003 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568423+0000", 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102675 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.492385943000002, 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084963339999999995, 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567651+0000", 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567703+0000", 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2142000000000003e-05 2024-04-26T02:25:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567774+0000", 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1445000000000005e-05 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567813+0000", 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9026000000000002e-05 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568266+0000", 2024-04-26T02:25:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045321000000000001 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568294+0000", 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.743e-05 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576057+0000", 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077626329999999997 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576146+0000", 2024-04-26T02:25:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9648000000000006e-05 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.492163345000002, 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014301641, 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567874+0000", 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.19e-06 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567930+0000", 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6505999999999997e-05 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567966+0000", 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5441999999999997e-05 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567986+0000", 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0086999999999999e-05 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569871+0000", 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001885751 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569896+0000", 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4369e-05 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582080+0000", 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012184133999999999 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582174+0000", 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4161999999999997e-05 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 66/31 ECSubWrite(tid=77, reqid=osd.15.0:77, at_version=66'60, trim_to=0'0, roll_forward_to=65'58))", 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.588734355, 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082262370000000008, 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471302+0000", 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2099999999999998e-07 2024-04-26T02:25:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471322+0000", 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0667000000000001e-05 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471336+0000", 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.348e-05 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471346+0000", 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6739999999999992e-06 2024-04-26T02:25:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471519+0000", 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017380499999999999 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471534+0000", 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479481+0000", 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079467189999999997 2024-04-26T02:25:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479528+0000", 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7051000000000001e-05 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.475579+0000", 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.584456587999998, 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066513470000000002, 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475579+0000", 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475579+0000", 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475580+0000", 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0699999999999998e-07 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475623+0000", 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3142000000000001e-05 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475639+0000", 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6562000000000002e-05 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475655+0000", 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5902000000000001e-05 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475728+0000", 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3313999999999996e-05 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475739+0000", 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0617e-05 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482180+0000", 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0064410969999999998 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482231+0000", 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0405999999999998e-05 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:25:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.584352976000002, 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0066723199999999998, 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475683+0000", 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.82e-07 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475706+0000", 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2748e-05 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475719+0000", 2024-04-26T02:25:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2520999999999999e-05 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.475727+0000", 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8249999999999994e-06 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.476211+0000", 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00048337800000000002 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.476227+0000", 2024-04-26T02:25:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6005999999999999e-05 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482326+0000", 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0060991550000000002 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.482355+0000", 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9204999999999999e-05 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=50, reqid=client.4589.0:655, at_version=80'37, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.533895866999998, 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093202319999999995, 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526141+0000", 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527110+0000", 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096976099999999997 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527145+0000", 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4860000000000002e-05 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527170+0000", 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5191999999999999e-05 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527416+0000", 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024589499999999999 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527442+0000", 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6013e-05 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535371+0000", 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079284000000000004 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535460+0000", 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9450999999999994e-05 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=51, reqid=client.4589.0:656, at_version=80'38, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.528764516999999, 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070853160000000004, 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531274+0000", 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.497e-06 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531789+0000", 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00051518199999999999 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531821+0000", 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2305999999999999e-05 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531844+0000", 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532644+0000", 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00080051600000000003 2024-04-26T02:25:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532671+0000", 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6588999999999999e-05 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538264+0000", 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055933129999999999 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538357+0000", 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2571000000000005e-05 2024-04-26T02:25:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 85/31 ECSubWrite(tid=143, reqid=osd.13.0:143, at_version=85'52, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.569744688, 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010592577000000001, 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490292+0000", 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490349+0000", 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6829000000000001e-05 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490671+0000", 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032284000000000002 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490754+0000", 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2491999999999996e-05 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490891+0000", 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013744699999999999 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490917+0000", 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6089e-05 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500787+0000", 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098697860000000002 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500884+0000", 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6403999999999994e-05 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 85/31 ECSubWrite(tid=144, reqid=osd.13.0:144, at_version=85'54, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 12.564671597, 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073014530000000003, 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495366+0000", 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1600000000000001e-06 2024-04-26T02:25:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495422+0000", 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6128999999999997e-05 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498136+0000", 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027135340000000001 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498169+0000", 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2876000000000002e-05 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498749+0000", 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058028799999999998 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498775+0000", 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6270000000000001e-05 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502568+0000", 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037923409999999999 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502666+0000", 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7855000000000004e-05 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 90/31 ECSubWrite(tid=295, reqid=client.4589.0:741, at_version=90'70, trim_to=0'0, roll_forward_to=85'68))", 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 7.5497187610000003, 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079796829999999996, 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510318+0000", 2024-04-26T02:25:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3030000000000001e-06 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510402+0000", 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3401999999999999e-05 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510440+0000", 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8145999999999997e-05 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510469+0000", 2024-04-26T02:25:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9212000000000001e-05 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510747+0000", 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027817899999999998 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510779+0000", 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2189e-05 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.518251+0000", 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007471648 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.518297+0000", 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5603999999999999e-05 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 95/31 ECSubWrite(tid=96, reqid=osd.8.0:96, at_version=95'73, trim_to=0'0, roll_forward_to=92'71))", 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.5733243940000001, 2024-04-26T02:25:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079293969999999995, 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486712+0000", 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3000000000000001e-07 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486765+0000", 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3492000000000002e-05 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486791+0000", 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6077000000000001e-05 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486814+0000", 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2762e-05 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486947+0000", 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013290200000000001 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486962+0000", 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5102999999999999e-05 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.494547+0000", 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007584833 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.494641+0000", 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3797999999999999e-05 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.149 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:05.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:25:05.151 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:05.146+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:05.252 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:05.251+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:05.271 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:05.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:25:05.353 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:05.352+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:05.406 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:05.406 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:05.417 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-14 --journal-path /var/lib/ceph/osd/ceph-14/journal --force --op remove --pgid 3.6s1 2024-04-26T02:25:05.422 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:25:05.454 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:05.450+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:05.495 INFO:tasks.rados.rados.0.smithi175.stdout:336: done (0 left) 2024-04-26T02:25:05.495 INFO:tasks.rados.rados.0.smithi175.stdout:337: snap_remove snap 35 2024-04-26T02:25:05.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:25:05.555 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:05.548+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.664904633000006, 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.073984011000000002, 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918606+0000", 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.396e-06 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918620+0000", 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918641+0000", 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0389000000000001e-05 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918657+0000", 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6671999999999999e-05 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918805+0000", 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014724900000000001 2024-04-26T02:25:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918819+0000", 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4453e-05 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.988816+0000", 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069997045999999993 2024-04-26T02:25:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989070+0000", 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025383399999999998 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989371+0000", 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030080500000000002 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.990597+0000", 2024-04-26T02:25:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012262740000000001 2024-04-26T02:25:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992421+0000", 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001824132 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992517+0000", 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5880999999999999e-05 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992587+0000", 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0359999999999997e-05 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.428187226999995, 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017505889, 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 88 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155322+0000", 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155328+0000", 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2700000000000001e-06 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155358+0000", 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0624999999999999e-05 2024-04-26T02:25:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155373+0000", 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4229999999999999e-05 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.162973+0000", 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076001050000000002 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163128+0000", 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015489200000000001 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163377+0000", 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024957100000000003 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.165420+0000", 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020422349999999999 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172717+0000", 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072976839999999996 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172781+0000", 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3910000000000003e-05 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172827+0000", 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5587000000000002e-05 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.256801132000007, 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018318649999999999, 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 114 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326708+0000", 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9700000000000005e-07 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326713+0000", 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326722+0000", 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9199999999999993e-06 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326729+0000", 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1489999999999997e-06 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339956+0000", 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013227153 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340087+0000", 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130946 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340294+0000", 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206434 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344052+0000", 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037581490000000001 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344900+0000", 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084779500000000004 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344967+0000", 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607000000000005e-05 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345026+0000", 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8146999999999997e-05 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.256768249999993, 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019222108000000002, 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 115 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0399999999999995e-07 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326874+0000", 2024-04-26T02:25:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013342599999999999 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326885+0000", 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1323e-05 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326893+0000", 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7659999999999998e-06 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.611 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342112+0000", 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015218537000000001 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342342+0000", 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023057199999999999 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.612 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342691+0000", 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034918900000000002 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345831+0000", 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031394740000000002 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345848+0000", 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7686e-05 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345912+0000", 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3709999999999998e-05 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345962+0000", 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9721e-05 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.256597579000001, 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019714167000000001, 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 116 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326911+0000", 2024-04-26T02:25:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326924+0000", 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2743e-05 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326934+0000", 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5459999999999997e-06 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326941+0000", 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1470000000000004e-06 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344124+0000", 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017183085000000001 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344238+0000", 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114591 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344425+0000", 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018710800000000001 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345974+0000", 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001548979 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346498+0000", 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052335399999999996 2024-04-26T02:25:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346570+0000", 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1983000000000005e-05 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346625+0000", 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4843999999999999e-05 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.256555586999994, 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020133699000000001, 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 117 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326953+0000", 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326959+0000", 2024-04-26T02:25:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.823e-06 2024-04-26T02:25:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326968+0000", 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9530000000000005e-06 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326979+0000", 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1289e-05 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345091+0000", 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018111505999999999 2024-04-26T02:25:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345217+0000", 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012587399999999999 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345409+0000", 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019226700000000001 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346352+0000", 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00094280000000000004 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346964+0000", 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061192899999999999 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347036+0000", 2024-04-26T02:25:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2120999999999996e-05 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347086+0000", 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0377000000000002e-05 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.091830900000005, 2024-04-26T02:25:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018319485, 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 139 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491678+0000", 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.333e-06 2024-04-26T02:25:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491688+0000", 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9299999999999998e-06 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491707+0000", 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8281999999999999e-05 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491720+0000", 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3502e-05 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504966+0000", 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013245808 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505190+0000", 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000223876 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505520+0000", 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032999 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508527+0000", 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030072739999999999 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509751+0000", 2024-04-26T02:25:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012241719999999999 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509880+0000", 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128687 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509997+0000", 2024-04-26T02:25:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116631 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.091767723999993, 2024-04-26T02:25:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018559454, 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 140 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491742+0000", 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.404e-06 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491946+0000", 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204086 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491967+0000", 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1049000000000001e-05 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491983+0000", 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6356000000000001e-05 2024-04-26T02:25:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507052+0000", 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015069173 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507208+0000", 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000155783 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507411+0000", 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020306 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510024+0000", 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026129 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510123+0000", 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8667999999999998e-05 2024-04-26T02:25:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510230+0000", 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107565 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510300+0000", 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9410000000000001e-05 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 77.091496699999993, 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018767703, 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 141 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492013+0000", 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492039+0000", 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5952000000000002e-05 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492058+0000", 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9215000000000002e-05 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492082+0000", 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4379000000000002e-05 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508623+0000", 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016540947 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508846+0000", 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022293599999999999 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509201+0000", 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035443900000000001 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510580+0000", 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013797379999999999 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510627+0000", 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6254000000000001e-05 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510715+0000", 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8215999999999997e-05 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510779+0000", 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4136999999999999e-05 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.780644769000006, 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018162602999999999, 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 186 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802865+0000", 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.666e-06 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802876+0000", 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1246e-05 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802898+0000", 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1645999999999999e-05 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802923+0000", 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5389e-05 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.815977+0000", 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013053301 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816115+0000", 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138553 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816319+0000", 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204236 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820746+0000", 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044270739999999996 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820868+0000", 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122127 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820949+0000", 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0395999999999994e-05 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821026+0000", 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6969000000000001e-05 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.780559339999996, 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018225614000000001, 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 187 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802950+0000", 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802963+0000", 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3206e-05 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802982+0000", 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8519e-05 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803002+0000", 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0162000000000001e-05 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816937+0000", 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013934867 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817068+0000", 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130734 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817285+0000", 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000217209 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820849+0000", 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035643160000000001 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821038+0000", 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000188767 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821122+0000", 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4243e-05 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821174+0000", 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2181000000000001e-05 2024-04-26T02:25:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.780463118, 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018460061999999999, 2024-04-26T02:25:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 188 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803046+0000", 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4500000000000001e-06 2024-04-26T02:25:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803180+0000", 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013367300000000001 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803201+0000", 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1399e-05 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803217+0000", 2024-04-26T02:25:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5556000000000001e-05 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818151+0000", 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014934374 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818319+0000", 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016765500000000001 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818541+0000", 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022229899999999999 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821196+0000", 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002654965 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821379+0000", 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018284400000000001 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821453+0000", 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3546000000000004e-05 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821505+0000", 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2301e-05 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 76.780263231999996, 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018840794000000001, 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803246+0000", 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803257+0000", 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0825999999999999e-05 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803275+0000", 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8099999999999999e-05 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803288+0000", 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2595999999999999e-05 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819675+0000", 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016387184999999999 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819800+0000", 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012490999999999999 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820077+0000", 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000277533 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821271+0000", 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193401 2024-04-26T02:25:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821965+0000", 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069420199999999999 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822036+0000", 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1119999999999997e-05 2024-04-26T02:25:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822086+0000", 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9400999999999997e-05 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:327 3.8s0 3:1859e9b5:::smithi17529564-39:head [create,setxattr `sjUtrS\\bejkdS^PZ^UbhfeR]sl^p__anSUR_aom (1578) in=40b,setxattr Xgg (981) in=3b,setxattr jjU_`S[ao\\\\^aUS`bZo^cefhdeaegSZfc]sS[m[k (631) in=40b,setxattr WptVXs^]ZljihqWVjRTTRsYbpoOd[kede^[d^iNS (15648) in=40b,setxattr NUPa_VdcRWiTY (981) in=13b,setxattr oapqrhbaXndiek^ec[NZPnlNjeX^`^^ht`__ll[g (630) in=40b,setxattr hUokalb_dNqZaP[SZdSptRb]ZndqQTkPSdWpXlg_ (1683) in=40b,setxattr SOaUaOtoOmejUfsqfadVc_\\fpWak\\^nknRQfaXOZ (9120) in=40b,setxattr r[RO_Pl (981) in=7b,setxattr OOd^ZXYi[]NO^mlSkQafkPlVaY`UYcd\\bnaQUZjq (1225) in=40b,setxattr mlY]_qqgYNhaYetZtkgQPN^a^VmW[amS`Qbadgjr (137) in=40b,setxattr iVYdjchT[j\\[\\\\Uto`qnjUcXas^PtqZa^VoRktTT (1823) in=40b,setxattr PhV`]ZkggalnUas (981) in=15b,setxattr [TNbUtYOkT`ZatPerOQOlk\\WahmgadNWaeRZ^YT\\ (1121) in=40b,setxattr aRqq]f]b_cobaZ`ZZRaattjja[X``PaT\\l\\^Y[jU (313) in=40b,setxattr qYXjVRWg (981) in=8b,setxattr cm`nfp^lmRcSZUsStaOg_omiONqeTRWUsOjm]png (1227) in=40b,setxattr _jtbmRhQeZe]nY\\TQctPVagWm[isibp]ooW`hq[Z (1367) in=40b,setxattr _Ybhal\\]RPkmpUPPRRb[_[YfQpj[aXsgkfNbeeOZ (946) in=40b,setxattr YeQo_aSrmVSirmpTkkZqfZaaqOtg\\X\\qoRPrjPai (1786) in=40b] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.097905668000003, 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019121231999999998, 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 327 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485606+0000", 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9339999999999999e-06 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485768+0000", 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162189 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485811+0000", 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2292000000000001e-05 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485835+0000", 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4182999999999999e-05 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485963+0000", 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128157 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485976+0000", 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2571999999999999e-05 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490733+0000", 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047575610000000004 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491054+0000", 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032119599999999999 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493981+0000", 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002926484 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503531+0000", 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009550088 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503808+0000", 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027720000000000002 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.504724+0000", 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091537599999999997 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:364 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.121473180000002, 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019186933, 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 364 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462038+0000", 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6800000000000002e-06 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462048+0000", 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0835999999999999e-05 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462072+0000", 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3693000000000002e-05 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462089+0000", 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6586e-05 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462283+0000", 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000194496 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462306+0000", 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2476e-05 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471461+0000", 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091555809999999994 2024-04-26T02:25:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471729+0000", 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026759800000000002 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.481222+0000", 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094929869999999996 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:365 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.121386575000002, 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021296017, 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 365 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462123+0000", 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.39e-06 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462153+0000", 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9685000000000001e-05 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462165+0000", 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2964e-05 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462181+0000", 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5778999999999999e-05 2024-04-26T02:25:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462501+0000", 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031995299999999999 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462521+0000", 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9715999999999999e-05 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473587+0000", 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01106558 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473802+0000", 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215899 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.483417+0000", 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096150509999999995 2024-04-26T02:25:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:366 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.121287993999999, 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022939240999999999, 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 366 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462221+0000", 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462229+0000", 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4560000000000003e-06 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462246+0000", 2024-04-26T02:25:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7116e-05 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462259+0000", 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3526999999999999e-05 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462633+0000", 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037355199999999998 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462652+0000", 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9165999999999999e-05 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478081+0000", 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015429238 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478329+0000", 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024798499999999999 2024-04-26T02:25:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.485159+0000", 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068299909999999997 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:508 3.8s0 3:1cc02c30:::smithi17529564-2:head [append 0~606208] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 38.111103425000003, 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018229054000000001, 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 508 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472408+0000", 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0800000000000002e-06 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473853+0000", 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014451850000000001 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473888+0000", 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4891999999999997e-05 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473913+0000", 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5123e-05 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474093+0000", 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018053700000000001 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474110+0000", 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6540000000000001e-05 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479082+0000", 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049724280000000001 2024-04-26T02:25:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479346+0000", 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026396500000000001 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.482004+0000", 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026579569999999999 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.489855+0000", 2024-04-26T02:25:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078503649999999998 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490489+0000", 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063439499999999995 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490634+0000", 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144587 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:775 3.8s0 3:1859e9b5:::smithi17529564-39:head [copy-from ver 26] snapc 21=[21,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.9364006710000004, 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018551978, 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 775 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647110+0000", 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6369999999999999e-06 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647123+0000", 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648317+0000", 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193789 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648344+0000", 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7373e-05 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648583+0000", 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000239299 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648858+0000", 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027470199999999999 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.660303+0000", 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01144469 2024-04-26T02:25:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.664020+0000", 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037173039999999998 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.665497+0000", 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001477351 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.665659+0000", 2024-04-26T02:25:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016211 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:825 3.8s0 3:1cddb788:::smithi17529564-8:head [read 0~3194880,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 2.993321291, 2024-04-26T02:25:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018450497999999999, 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590188+0000", 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1299999999999998e-07 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590192+0000", 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7829999999999998e-06 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590242+0000", 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9406000000000001e-05 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590251+0000", 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.38e-06 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.595683+0000", 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054322459999999999 2024-04-26T02:25:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.595932+0000", 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024895599999999999 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.608637+0000", 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012704814 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:05.710 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:05.712 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:25:05.713 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:05.711+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:05.813 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:05.810+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:05.845 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:05.845 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:05.845 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:05.845 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:05.858 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:25:05.914 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:05.910+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:05.975 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:05.975 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:05.975 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:05.975 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:05.975 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:05.989 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:25:06.015 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:06.008+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:06.113 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:06.113 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:06.113 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:06.113 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:06.113 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 61.070552188000001, 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082822989999999999, 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039355+0000", 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3300000000000001e-07 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039418+0000", 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2694999999999995e-05 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039447+0000", 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9442e-05 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039470+0000", 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039659+0000", 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018914299999999999 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039683+0000", 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3915999999999999e-05 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047533+0000", 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078494710000000002 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047636+0000", 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103566 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 60.068376637, 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011160114, 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4000000000000002e-07 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041580+0000", 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9351999999999998e-05 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041619+0000", 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9152000000000001e-05 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041643+0000", 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.421e-05 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041841+0000", 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197784 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041867+0000", 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5939e-05 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052596+0000", 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01072906 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052690+0000", 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4077000000000001e-05 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 43.250437666000003, 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083055990000000003, 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.124 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:06.124 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.125 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.125 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.125 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8700000000000001e-07 2024-04-26T02:25:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862768+0000", 2024-04-26T02:25:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003299438 2024-04-26T02:25:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862799+0000", 2024-04-26T02:25:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0465999999999999e-05 2024-04-26T02:25:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.128 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.128 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.128 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862815+0000", 2024-04-26T02:25:06.129 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6118999999999999e-05 2024-04-26T02:25:06.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.130 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.130 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.130 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862957+0000", 2024-04-26T02:25:06.130 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014188100000000001 2024-04-26T02:25:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862972+0000", 2024-04-26T02:25:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5512999999999999e-05 2024-04-26T02:25:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867700+0000", 2024-04-26T02:25:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00472735 2024-04-26T02:25:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867774+0000", 2024-04-26T02:25:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4444999999999996e-05 2024-04-26T02:25:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs2 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:25:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.548521285, 2024-04-26T02:25:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093447500000000006, 2024-04-26T02:25:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.136 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:06.136 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561386+0000", 2024-04-26T02:25:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8999999999999996e-07 2024-04-26T02:25:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561441+0000", 2024-04-26T02:25:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5689000000000002e-05 2024-04-26T02:25:06.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.139 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.139 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.140 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561502+0000", 2024-04-26T02:25:06.140 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0788000000000001e-05 2024-04-26T02:25:06.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561527+0000", 2024-04-26T02:25:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4479999999999999e-05 2024-04-26T02:25:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561735+0000", 2024-04-26T02:25:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020879899999999999 2024-04-26T02:25:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561760+0000", 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5003000000000001e-05 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570592+0000", 2024-04-26T02:25:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088311770000000008 2024-04-26T02:25:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570730+0000", 2024-04-26T02:25:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138224 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.543851977999999, 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013994609999999999, 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566055+0000", 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566133+0000", 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7651999999999994e-05 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566166+0000", 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3189999999999999e-05 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566189+0000", 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3315e-05 2024-04-26T02:25:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566604+0000", 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041534500000000002 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566631+0000", 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6792999999999999e-05 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579960+0000", 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013328751 2024-04-26T02:25:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580049+0000", 2024-04-26T02:25:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8918000000000005e-05 2024-04-26T02:25:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.541778807999997, 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015943736999999999, 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568128+0000", 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3e-07 2024-04-26T02:25:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568181+0000", 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2899000000000003e-05 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568212+0000", 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0596000000000003e-05 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568238+0000", 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6169999999999998e-05 2024-04-26T02:25:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568483+0000", 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000245121 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568508+0000", 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5593e-05 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.583979+0000", 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015470133 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584071+0000", 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2595000000000004e-05 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.539134042999997, 2024-04-26T02:25:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013783561999999999, 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570774+0000", 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6029999999999999e-06 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570834+0000", 2024-04-26T02:25:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0248999999999999e-05 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570863+0000", 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8473e-05 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570927+0000", 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4335e-05 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571242+0000", 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000315144 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571308+0000", 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5808000000000004e-05 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584459+0000", 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013150818 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584556+0000", 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7132000000000004e-05 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:06.161 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.535851944000001, 2024-04-26T02:25:06.161 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011186935, 2024-04-26T02:25:06.161 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.161 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574055+0000", 2024-04-26T02:25:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574110+0000", 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4701999999999999e-05 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574134+0000", 2024-04-26T02:25:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4672999999999999e-05 2024-04-26T02:25:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574153+0000", 2024-04-26T02:25:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8372999999999998e-05 2024-04-26T02:25:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576753+0000", 2024-04-26T02:25:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026005830000000001 2024-04-26T02:25:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576778+0000", 2024-04-26T02:25:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4793000000000001e-05 2024-04-26T02:25:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585168+0000", 2024-04-26T02:25:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083896360000000007 2024-04-26T02:25:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585241+0000", 2024-04-26T02:25:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3515000000000003e-05 2024-04-26T02:25:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:25:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.534159586000001, 2024-04-26T02:25:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084735320000000006, 2024-04-26T02:25:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575749+0000", 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8700000000000001e-06 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575775+0000", 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6783000000000001e-05 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575804+0000", 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8296000000000001e-05 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575826+0000", 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1970000000000001e-05 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576058+0000", 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023252799999999999 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576084+0000", 2024-04-26T02:25:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5469e-05 2024-04-26T02:25:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584119+0000", 2024-04-26T02:25:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080353009999999999 2024-04-26T02:25:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584220+0000", 2024-04-26T02:25:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101315 2024-04-26T02:25:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.531046603, 2024-04-26T02:25:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010250464000000001, 2024-04-26T02:25:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578862+0000", 2024-04-26T02:25:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.136e-06 2024-04-26T02:25:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578953+0000", 2024-04-26T02:25:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1671999999999999e-05 2024-04-26T02:25:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578986+0000", 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2431999999999997e-05 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579009+0000", 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2997e-05 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580832+0000", 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018229279999999999 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580857+0000", 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5069999999999999e-05 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589005+0000", 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081481079999999994 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589110+0000", 2024-04-26T02:25:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105121 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 70/31 ECSubWrite(tid=55, reqid=client.4589.0:560, at_version=70'42, trim_to=0'0, roll_forward_to=66'40))", 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.544658367, 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093224269999999995, 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565250+0000", 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6199999999999999e-06 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565896+0000", 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064622300000000002 2024-04-26T02:25:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565930+0000", 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4175999999999999e-05 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565946+0000", 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6552999999999999e-05 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566110+0000", 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000163468 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566143+0000", 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2833000000000002e-05 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574369+0000", 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082260839999999998 2024-04-26T02:25:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574570+0000", 2024-04-26T02:25:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020147000000000001 2024-04-26T02:25:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 70/31 ECSubWrite(tid=94, reqid=client.4589.0:568, at_version=70'45, trim_to=0'0, roll_forward_to=66'44))", 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 28.519939274999999, 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008202048, 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589975+0000", 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3129999999999999e-06 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590472+0000", 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00049691600000000002 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590505+0000", 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2285e-05 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590526+0000", 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1923999999999999e-05 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590669+0000", 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014244400000000001 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590693+0000", 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4459000000000001e-05 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598075+0000", 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073818080000000001 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598169+0000", 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3899000000000003e-05 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.631821866999999, 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082988119999999992, 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478086+0000", 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.734e-06 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478493+0000", 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040724799999999997 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478528+0000", 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4873000000000003e-05 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478550+0000", 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2056e-05 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478704+0000", 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015417299999999999 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478732+0000", 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7063000000000002e-05 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486268+0000", 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075361270000000001 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486383+0000", 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115538 2024-04-26T02:25:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.483691+0000", 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.626215568999999, 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081778570000000002, 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483691+0000", 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483691+0000", 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483693+0000", 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3259999999999998e-06 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483748+0000", 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5232999999999998e-05 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483782+0000", 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3964999999999998e-05 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.483805+0000", 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2359999999999999e-05 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485215+0000", 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001410761 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.485241+0000", 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6143e-05 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491774+0000", 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0065329079999999996 2024-04-26T02:25:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491869+0000", 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4160999999999995e-05 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=143, reqid=osd.13.0:143, at_version=85'52, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.62166728, 2024-04-26T02:25:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011977942, 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488240+0000", 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0999999999999999e-07 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488293+0000", 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3179e-05 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488325+0000", 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2786000000000001e-05 2024-04-26T02:25:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488348+0000", 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2572999999999999e-05 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488541+0000", 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019315599999999999 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488567+0000", 2024-04-26T02:25:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5746e-05 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500120+0000", 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011552644000000001 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500217+0000", 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7348000000000004e-05 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s5 85/31 ECSubWrite(tid=44, reqid=osd.3.0:44, at_version=85'40, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.489090+0000", 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.620816011000001, 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080004470000000008, 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489090+0000", 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489090+0000", 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489092+0000", 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.68e-06 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489142+0000", 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0185000000000001e-05 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489172+0000", 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9709999999999998e-05 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489198+0000", 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6308999999999998e-05 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489453+0000", 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025496200000000002 2024-04-26T02:25:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.489479+0000", 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6049000000000001e-05 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496999+0000", 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075202309999999996 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.497091+0000", 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1321000000000002e-05 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s5 85/31 ECSubWrite(tid=45, reqid=osd.3.0:45, at_version=85'42, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.617941201000001, 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093409329999999992, 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491967+0000", 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:25:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492019+0000", 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2326e-05 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492059+0000", 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0499e-05 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492088+0000", 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8883000000000001e-05 2024-04-26T02:25:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493095+0000", 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010064850000000001 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493119+0000", 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3900000000000002e-05 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501188+0000", 2024-04-26T02:25:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080696529999999995 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501306+0000", 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011764699999999999 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 85/31 ECSubWrite(tid=259, reqid=osd.6.0:259, at_version=85'86, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.617793934, 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091845999999999994, 2024-04-26T02:25:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492113+0000", 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1399999999999997e-07 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492162+0000", 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9152e-05 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492192+0000", 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9983000000000001e-05 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492215+0000", 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3206000000000001e-05 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492386+0000", 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000170466 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5225999999999999e-05 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501191+0000", 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087800949999999999 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501297+0000", 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105858 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 85/31 ECSubWrite(tid=57, reqid=osd.14.0:57, at_version=85'56, trim_to=0'0, roll_forward_to=82'54))", 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.617531359000001, 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088827960000000001, 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492376+0000", 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1600000000000001e-07 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492431+0000", 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5229000000000003e-05 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492463+0000", 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2716000000000003e-05 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492487+0000", 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3050000000000001e-05 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492914+0000", 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042767800000000002 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492946+0000", 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1772e-05 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501157+0000", 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082111800000000002 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.227 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501258+0000", 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100555 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=144, reqid=osd.13.0:144, at_version=85'54, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.613758534, 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083376070000000004, 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:06.228 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496155+0000", 2024-04-26T02:25:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5669999999999997e-06 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496209+0000", 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3538999999999997e-05 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496244+0000", 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4665000000000001e-05 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496267+0000", 2024-04-26T02:25:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3533e-05 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496416+0000", 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014877400000000001 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496443+0000", 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7146000000000001e-05 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504421+0000", 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079782480000000003 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504485+0000", 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4134999999999995e-05 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:06.232 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:06.234 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:25:06.234 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:06.230+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:06.335 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:06.328+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:06.366 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:06.367 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:06.367 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:06.367 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:06.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:25:06.436 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:06.435+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:06.490 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:25:06.498 INFO:tasks.rados.rados.0.smithi175.stdout:337: done (0 left) 2024-04-26T02:25:06.499 INFO:tasks.rados.rados.0.smithi175.stdout:338: snap_remove snap 29 2024-04-26T02:25:06.537 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:06.532+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:06.546 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:06.546 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:06.547 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:06.547 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:06.547 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:06.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:25:06.606 INFO:teuthology.orchestra.run.smithi142.stdout: marking collection for removal 2024-04-26T02:25:06.606 INFO:teuthology.orchestra.run.smithi142.stdout:setting '_remove' omap key 2024-04-26T02:25:06.607 INFO:teuthology.orchestra.run.smithi142.stdout:finish_remove_pgs 3.6s1_head removing 3.6s1 2024-04-26T02:25:06.609 INFO:teuthology.orchestra.run.smithi142.stdout:Remove successful 2024-04-26T02:25:06.638 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:06.635+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:06.732 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:06.732 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 61.693658454999998, 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011126728000000001, 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:06.733 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034940+0000", 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.663e-06 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034988+0000", 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7794999999999999e-05 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.734 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035017+0000", 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9139e-05 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035039+0000", 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2178999999999999e-05 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035616+0000", 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057682000000000002 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.735 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035639+0000", 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2915999999999999e-05 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045974+0000", 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01033568 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046065+0000", 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0536000000000002e-05 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.736 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=132, reqid=osd.12.0:132, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.162497457000001, 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012148091999999999, 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.737 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566100+0000", 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5400000000000002e-07 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.738 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566148+0000", 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8294999999999998e-05 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566223+0000", 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5108e-05 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566249+0000", 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6033e-05 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.739 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566409+0000", 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015976299999999999 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566436+0000", 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7226e-05 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578152+0000", 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011716358 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.740 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578247+0000", 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4854999999999999e-05 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.161656227000002, 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010768801999999999, 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.741 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566941+0000", 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:25:06.742 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566993+0000", 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2308999999999997e-05 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567025+0000", 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1934999999999998e-05 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567047+0000", 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2024000000000001e-05 2024-04-26T02:25:06.743 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567199+0000", 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000151662 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567223+0000", 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3717e-05 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577442+0000", 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010219257000000001 2024-04-26T02:25:06.744 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577709+0000", 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000267211 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:06.745 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.161499773000003, 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014918226, 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.746 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567098+0000", 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.463e-06 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567147+0000", 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8551999999999999e-05 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.747 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567169+0000", 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2215999999999999e-05 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567188+0000", 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8756000000000001e-05 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571613+0000", 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004424936 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.748 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9245000000000001e-05 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581898+0000", 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010246251 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.582015+0000", 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011680699999999999 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.749 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.158092357999998, 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013337598000000001, 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.750 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570506+0000", 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.844e-06 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570590+0000", 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3950999999999996e-05 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570623+0000", 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3315999999999997e-05 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570651+0000", 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7319000000000001e-05 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571614+0000", 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00096303399999999998 2024-04-26T02:25:06.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8068999999999998e-05 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583776+0000", 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012123818999999999 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583842+0000", 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6246000000000002e-05 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.753 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.155732684, 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011065805, 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.754 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572865+0000", 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9400000000000004e-07 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572920+0000", 2024-04-26T02:25:06.755 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5031999999999998e-05 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572952+0000", 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1992000000000001e-05 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572974+0000", 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1829999999999999e-05 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573193+0000", 2024-04-26T02:25:06.756 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021909100000000001 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573218+0000", 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5363000000000001e-05 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583849+0000", 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010630472 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583930+0000", 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1230999999999995e-05 2024-04-26T02:25:06.757 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=170, reqid=osd.0.0:167, at_version=0'0, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.136190423999999, 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010391315999999999, 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.758 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592406+0000", 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592407+0000", 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5099999999999998e-07 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.759 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592430+0000", 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2971000000000001e-05 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592453+0000", 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2988000000000001e-05 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592470+0000", 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6490999999999998e-05 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.760 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594588+0000", 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021184369999999999 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594615+0000", 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6835999999999999e-05 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.602725+0000", 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0081098209999999997 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.761 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.602798+0000", 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2921000000000002e-05 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 59/31 ECSubWrite(tid=47, reqid=osd.11.0:47, at_version=59'36, trim_to=0'0, roll_forward_to=58'32))", 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.136035301, 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009047088, 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.762 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592561+0000", 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592562+0000", 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0999999999999997e-07 2024-04-26T02:25:06.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592623+0000", 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.0588999999999999e-05 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592692+0000", 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8748e-05 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592710+0000", 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:25:06.764 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592963+0000", 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025237000000000002 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.592988+0000", 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4916999999999999e-05 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601500+0000", 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085119800000000006 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.765 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.601608+0000", 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010890100000000001 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=171, reqid=osd.0.0:171, at_version=59'77, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.135149921, 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010285917, 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.766 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593447+0000", 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593448+0000", 2024-04-26T02:25:06.767 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.435e-06 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593492+0000", 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3446999999999999e-05 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593546+0000", 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4098999999999998e-05 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.593567+0000", 2024-04-26T02:25:06.768 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1435999999999999e-05 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.596136+0000", 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025689850000000002 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.596172+0000", 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6155999999999997e-05 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603019+0000", 2024-04-26T02:25:06.769 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068466730000000002 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603733+0000", 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00071368600000000005 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 59/31 ECSubWrite(tid=172, reqid=osd.0.0:172, at_version=59'79, trim_to=0'0, roll_forward_to=59'75))", 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.133504197999997, 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089727690000000002, 2024-04-26T02:25:06.770 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595092+0000", 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.771 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595093+0000", 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.017e-06 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595136+0000", 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2545e-05 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595175+0000", 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9230000000000002e-05 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.772 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595194+0000", 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8802000000000001e-05 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.599876+0000", 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0046815709999999998 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.599899+0000", 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3608000000000002e-05 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.773 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.603988+0000", 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040892289999999998 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.604065+0000", 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6767000000000005e-05 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 66/31 ECSubWrite(tid=52, reqid=osd.11.0:52, at_version=66'38, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:25:06.774 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.237017256000001, 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097978149999999996, 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491579+0000", 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.775 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491580+0000", 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2600000000000001e-07 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491602+0000", 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2365999999999999e-05 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491639+0000", 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6505999999999999e-05 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.776 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491659+0000", 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0976e-05 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491789+0000", 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000129944 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.491814+0000", 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4732999999999999e-05 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.777 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.501242+0000", 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0094274879999999995 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.501377+0000", 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013557599999999999 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:25:06.778 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.234634083000003, 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010380267, 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493963+0000", 2024-04-26T02:25:06.779 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.493964+0000", 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8470000000000001e-06 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494018+0000", 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3158999999999997e-05 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494061+0000", 2024-04-26T02:25:06.780 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3278999999999997e-05 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494103+0000", 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2449e-05 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494599+0000", 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049539600000000005 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494625+0000", 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6075999999999999e-05 2024-04-26T02:25:06.781 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.504220+0000", 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.009595091 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.504343+0000", 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012297 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.782 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.234339421999998, 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010850225, 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.783 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494258+0000", 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1069999999999999e-06 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494289+0000", 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0175000000000002e-05 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494320+0000", 2024-04-26T02:25:06.784 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1869999999999998e-05 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494360+0000", 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9952e-05 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496568+0000", 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022078480000000001 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.785 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496593+0000", 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4641999999999999e-05 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505054+0000", 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084610469999999993 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505107+0000", 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3584000000000001e-05 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.786 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=205, reqid=osd.0.0:205, at_version=66'108, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.232879539000002, 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0096827960000000005, 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.787 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495717+0000", 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495719+0000", 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7630000000000001e-06 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495769+0000", 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0331999999999999e-05 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.788 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495801+0000", 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2089999999999999e-05 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.495824+0000", 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2368999999999999e-05 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497475+0000", 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016509960000000001 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.497506+0000", 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1126e-05 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505332+0000", 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0078265839999999993 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505400+0000", 2024-04-26T02:25:06.790 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7535999999999998e-05 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(osd.13.22:2 3.7s0 3:e9c97fb0:::smithi17529564-43:head [assert-version v4,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:43.479795+0000", 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.248801456999999, 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095388049999999992, 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.791 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479795+0000", 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479795+0000", 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.792 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479798+0000", 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6000000000000001e-06 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479809+0000", 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1212999999999999e-05 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479830+0000", 2024-04-26T02:25:06.793 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1348e-05 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479850+0000", 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0058999999999999e-05 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479928+0000", 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8026000000000001e-05 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.479934+0000", 2024-04-26T02:25:06.794 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3870000000000003e-06 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.483150+0000", 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0032158479999999999 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.483227+0000", 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7336999999999995e-05 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:43.489334+0000", 2024-04-26T02:25:06.795 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061069870000000004 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=77, reqid=osd.11.0:77, at_version=85'63, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.248742869999999, 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012557278, 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.796 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9299999999999997e-07 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.797 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479907+0000", 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2293999999999998e-05 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479938+0000", 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0728999999999997e-05 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479960+0000", 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.798 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480947+0000", 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0009871490000000001 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480973+0000", 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5704999999999999e-05 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492318+0000", 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0113448 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.799 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3225000000000003e-05 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 85/31 ECSubWrite(tid=84, reqid=osd.8.0:84, at_version=85'61, trim_to=0'0, roll_forward_to=83'59))", 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.245169616, 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011418342, 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.800 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483428+0000", 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:25:06.801 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483486+0000", 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8236999999999998e-05 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483515+0000", 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9169000000000001e-05 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483539+0000", 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4226000000000001e-05 2024-04-26T02:25:06.802 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484639+0000", 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001099952 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484657+0000", 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7496999999999999e-05 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494743+0000", 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010086573 2024-04-26T02:25:06.803 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494845+0000", 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102042 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.244080051999999, 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010793934, 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.804 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484518+0000", 2024-04-26T02:25:06.805 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.22e-06 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484568+0000", 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9798e-05 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484599+0000", 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1384999999999999e-05 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484621+0000", 2024-04-26T02:25:06.806 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1818999999999999e-05 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492500+0000", 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007879268 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492527+0000", 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7212e-05 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495235+0000", 2024-04-26T02:25:06.807 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027078060000000001 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495311+0000", 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5426000000000006e-05 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 90/31 ECSubWrite(tid=288, reqid=client.4589.0:736, at_version=90'154, trim_to=0'0, roll_forward_to=88'152))", 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.2413036660000003, 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012431226, 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.808 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.809 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487294+0000", 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7700000000000004e-07 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487571+0000", 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027720199999999999 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487600+0000", 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9028999999999999e-05 2024-04-26T02:25:06.810 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487617+0000", 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6878999999999999e-05 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487802+0000", 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018537999999999999 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487856+0000", 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4237000000000003e-05 2024-04-26T02:25:06.811 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499640+0000", 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011783903 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499724+0000", 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4018999999999996e-05 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.812 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 90/31 ECSubWrite(tid=289, reqid=client.4589.0:737, at_version=90'156, trim_to=0'0, roll_forward_to=88'152))", 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.489653+0000", 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.2389440930000006, 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010172966, 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489653+0000", 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489653+0000", 2024-04-26T02:25:06.813 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489655+0000", 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.446e-06 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489707+0000", 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2237999999999997e-05 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489741+0000", 2024-04-26T02:25:06.814 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4032999999999998e-05 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489765+0000", 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3679000000000001e-05 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489916+0000", 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015152699999999999 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.489942+0000", 2024-04-26T02:25:06.815 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5479000000000001e-05 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499745+0000", 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098032439999999992 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499826+0000", 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0320000000000003e-05 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:06.816 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:06.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:25:06.819 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:06.815+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:06.919 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:25:06.915+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:25:06.946 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:06.946 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:06.946 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:06.946 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:06.960 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:25:07.020 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:07.016+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:07.078 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:07.079 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:07.079 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:07.079 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:07.079 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:07.094 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:25:07.137 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:07.132+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:07.148 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-14 --journal-path /var/lib/ceph/osd/ceph-14/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.6s1.14 2024-04-26T02:25:07.222 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:07.219+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:07.258 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.14 2024-04-26T02:25:07.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:25:07.254+0000 7f4631ae6640 0 -- 172.21.15.59:0/3434892673 >> [v2:172.21.15.175:6816/1433451080,v1:172.21.15.175:6817/1433451080] conn(0x7f462c222e20 msgr2=0x7f462c225210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-04-26T02:25:07.262 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:07.262 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:07.262 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:07.262 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:406 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~475136] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.464161673, 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010860336999999999, 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 406 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.263 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794007+0000", 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4770000000000002e-06 2024-04-26T02:25:07.264 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794660+0000", 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065313299999999997 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794694+0000", 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4014999999999999e-05 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.265 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794716+0000", 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2846000000000001e-05 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795033+0000", 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000316965 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795302+0000", 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268853 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.266 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.797207+0000", 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019045690000000001 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803798+0000", 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006591281 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.267 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804729+0000", 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00093087200000000001 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804864+0000", 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013532600000000001 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.268 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:409 3.bs0 3:d145576f:::smithi17529564-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.462177208999996, 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013475743, 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 409 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.269 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.270 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795990+0000", 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.42e-06 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795995+0000", 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5799999999999999e-06 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796017+0000", 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1778999999999999e-05 2024-04-26T02:25:07.271 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796033+0000", 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6022999999999999e-05 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806706+0000", 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010672472000000001 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806946+0000", 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024007 2024-04-26T02:25:07.272 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809464+0000", 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025183990000000002 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:413 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~131072] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.444359702, 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011855436, 2024-04-26T02:25:07.273 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 413 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.274 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813808+0000", 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0200000000000001e-06 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813887+0000", 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9437999999999994e-05 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813913+0000", 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5082000000000001e-05 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813931+0000", 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.859e-05 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818168+0000", 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042373460000000003 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.276 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818314+0000", 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000145289 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819109+0000", 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079474400000000001 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825348+0000", 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062396159999999999 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.277 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825501+0000", 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152583 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825661+0000", 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016072800000000001 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:414 3.bs0 3:db601e58:::smithi17529564-10:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:25:07.278 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.444203328999997, 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012515695, 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 414 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:25:07.279 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813964+0000", 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.59e-06 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.280 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813973+0000", 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6689999999999995e-06 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813993+0000", 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0440000000000001e-05 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814007+0000", 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4073000000000001e-05 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.281 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819880+0000", 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058725599999999998 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820055+0000", 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017564800000000001 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820866+0000", 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000810299 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.282 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826013+0000", 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051474570000000002 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826385+0000", 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00037209199999999997 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826478+0000", 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2867000000000004e-05 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.283 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:415 3.bs0 3:db601e58:::smithi17529564-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.444138895000002, 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014775608000000001, 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 415 2024-04-26T02:25:07.284 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.285 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814028+0000", 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2270000000000001e-06 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814034+0000", 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6230000000000002e-06 2024-04-26T02:25:07.286 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814070+0000", 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6513000000000001e-05 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814083+0000", 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.332e-05 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821842+0000", 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077589859999999998 2024-04-26T02:25:07.287 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821934+0000", 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1736000000000004e-05 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826791+0000", 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048572470000000003 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826870+0000", 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8065999999999994e-05 2024-04-26T02:25:07.288 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.828802+0000", 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00193289 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.690018405000004, 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01558203, 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.289 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.290 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568148+0000", 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5300000000000004e-07 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568196+0000", 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8158999999999997e-05 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568232+0000", 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5565999999999998e-05 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568269+0000", 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568551+0000", 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028192700000000001 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568576+0000", 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5171999999999999e-05 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.292 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583637+0000", 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015060841 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583729+0000", 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2570000000000003e-05 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:25:07.293 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:25:07.294 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.688619787999997, 2024-04-26T02:25:07.294 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015014527, 2024-04-26T02:25:07.294 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.294 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.294 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.294 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.294 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.297 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569547+0000", 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-07 2024-04-26T02:25:07.298 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569597+0000", 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0417999999999997e-05 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569626+0000", 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9087000000000001e-05 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569648+0000", 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1869e-05 2024-04-26T02:25:07.299 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569790+0000", 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014197 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569814+0000", 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3748999999999999e-05 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584483+0000", 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014669006 2024-04-26T02:25:07.300 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584560+0000", 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7785000000000001e-05 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.683075109999997, 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010327464999999999, 2024-04-26T02:25:07.301 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.302 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575092+0000", 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575136+0000", 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4712000000000002e-05 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.303 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575161+0000", 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4396000000000002e-05 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575179+0000", 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8445999999999999e-05 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575319+0000", 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013968699999999999 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.304 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575344+0000", 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5153000000000001e-05 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585327+0000", 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099826429999999994 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585418+0000", 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1471000000000006e-05 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.305 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.682922071, 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012320048, 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:25:07.306 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575245+0000", 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1039999999999999e-06 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575287+0000", 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2122000000000001e-05 2024-04-26T02:25:07.307 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575310+0000", 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3139999999999999e-05 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575328+0000", 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7932e-05 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575669+0000", 2024-04-26T02:25:07.308 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340749 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575694+0000", 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587485+0000", 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01179094 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.309 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587564+0000", 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8610999999999997e-05 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.682750308000003, 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013969232, 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.310 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575416+0000", 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6000000000000004e-07 2024-04-26T02:25:07.311 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575457+0000", 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1006e-05 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575475+0000", 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8280000000000001e-05 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575492+0000", 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6455000000000001e-05 2024-04-26T02:25:07.312 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575788+0000", 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029676700000000003 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575812+0000", 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3866000000000002e-05 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589304+0000", 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013491306999999999 2024-04-26T02:25:07.313 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589385+0000", 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0990999999999998e-05 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.681855599000002, 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013188284, 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.314 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.315 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576312+0000", 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.88e-06 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576362+0000", 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9518999999999998e-05 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576392+0000", 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0278999999999999e-05 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.316 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576413+0000", 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0879000000000001e-05 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576631+0000", 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000217858 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576656+0000", 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5230000000000001e-05 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.317 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589395+0000", 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012739034999999999 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589498+0000", 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010360400000000001 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:520 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:25:07.318 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.788763713000002, 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013039524, 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 520 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:25:07.319 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469405+0000", 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.993e-06 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469418+0000", 2024-04-26T02:25:07.320 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2693e-05 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469453+0000", 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5679000000000002e-05 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469482+0000", 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8943000000000001e-05 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.321 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469661+0000", 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000178486 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469674+0000", 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3112000000000001e-05 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473010+0000", 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033360080000000001 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.322 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473163+0000", 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000153323 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.474753+0000", 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001589752 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482102+0000", 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073493830000000001 2024-04-26T02:25:07.323 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482270+0000", 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000167176 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482442+0000", 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017197600000000001 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.324 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:521 3.bs0 3:db601e58:::smithi17529564-10:head [rollback d] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.788625733000003, 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013833965, 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 521 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.325 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469541+0000", 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.513e-06 2024-04-26T02:25:07.326 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469548+0000", 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0129999999999996e-06 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469570+0000", 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1146e-05 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469590+0000", 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0089e-05 2024-04-26T02:25:07.327 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469805+0000", 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000215672 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469818+0000", 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2527000000000001e-05 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476615+0000", 2024-04-26T02:25:07.328 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067965919999999997 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476905+0000", 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029089300000000002 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.478553+0000", 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016476380000000001 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.329 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482879+0000", 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043259839999999997 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483241+0000", 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036179499999999999 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483374+0000", 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000133103 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.330 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:522 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 38.788519225999998, 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015161644, 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 522 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.331 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469648+0000", 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.77e-06 2024-04-26T02:25:07.332 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469654+0000", 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.117e-06 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469675+0000", 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0455e-05 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469692+0000", 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.333 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469872+0000", 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017992299999999999 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469881+0000", 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5959999999999993e-06 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479445+0000", 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095639639999999995 2024-04-26T02:25:07.334 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479611+0000", 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016535200000000001 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.480621+0000", 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00101044 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482888+0000", 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022665620000000002 2024-04-26T02:25:07.335 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484697+0000", 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018098109999999999 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484808+0000", 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110754 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.336 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.781867912999999, 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010206114000000001, 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.337 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476298+0000", 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476299+0000", 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9299999999999996e-07 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476352+0000", 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3522e-05 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.338 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476382+0000", 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0116000000000001e-05 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476404+0000", 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2135999999999999e-05 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476629+0000", 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022486899999999999 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.339 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.476656+0000", 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6176000000000001e-05 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.486405+0000", 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0097497039999999997 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.486504+0000", 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8697999999999996e-05 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.340 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.780641082999999, 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013025037999999999, 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.341 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477526+0000", 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3e-06 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477587+0000", 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1579000000000001e-05 2024-04-26T02:25:07.342 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477611+0000", 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3560000000000001e-05 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477623+0000", 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2149e-05 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480063+0000", 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024397440000000002 2024-04-26T02:25:07.343 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480088+0000", 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5295000000000001e-05 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490508+0000", 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010419741 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490550+0000", 2024-04-26T02:25:07.344 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1669999999999999e-05 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 33.778994234000002, 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011565971, 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.345 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479172+0000", 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9500000000000001e-07 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.346 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479197+0000", 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5130000000000002e-05 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479209+0000", 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.15e-05 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479218+0000", 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2199999999999998e-06 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480190+0000", 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00097207200000000004 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480199+0000", 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3739999999999998e-06 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490652+0000", 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010453069000000001 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490737+0000", 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5810999999999995e-05 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 92/31 ECSubWrite(tid=309, reqid=client.4589.0:769, at_version=92'163, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.6308419089999999, 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018195949999999999, 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.349 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.350 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9699999999999995e-07 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629426+0000", 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021012890000000001 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629459+0000", 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2799000000000002e-05 2024-04-26T02:25:07.351 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629482+0000", 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3833e-05 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629894+0000", 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041181099999999999 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629923+0000", 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9172000000000001e-05 2024-04-26T02:25:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645444+0000", 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015520734 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645520+0000", 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5615e-05 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 92/31 ECSubWrite(tid=312, reqid=osd.0.0:312, at_version=92'165, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629545+0000", 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.6286211040000005, 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016003218999999999, 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629545+0000", 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.354 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629545+0000", 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629546+0000", 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8599999999999996e-07 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629589+0000", 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3096000000000002e-05 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629613+0000", 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3992e-05 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629631+0000", 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8303000000000001e-05 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634337+0000", 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047058839999999996 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634364+0000", 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6936000000000001e-05 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645528+0000", 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011164121000000001 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645548+0000", 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9901000000000001e-05 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.357 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 92/31 ECSubWrite(tid=313, reqid=osd.0.0:313, at_version=92'167, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.634291+0000", 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 7.6238748909999998, 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011276860999999999, 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634291+0000", 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634291+0000", 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634293+0000", 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9989999999999998e-06 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.359 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634351+0000", 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8671999999999997e-05 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634374+0000", 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2501999999999999e-05 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634393+0000", 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9262999999999998e-05 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635872+0000", 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014787890000000001 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635888+0000", 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.632e-05 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645552+0000", 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00966324 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645568+0000", 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6076e-05 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.362 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:07.364 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:25:07.364 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:07.362+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:07.465 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:07.459+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:07.486 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:25:07.487 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:25:07.491 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:07.491 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:07.491 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:07.491 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:07.492 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T02:25:07.493 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T02:25:07.506 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:25:07.514 INFO:tasks.rados.rados.0.smithi175.stdout:338: done (0 left) 2024-04-26T02:25:07.514 INFO:tasks.rados.rados.0.smithi175.stdout:339: setattr oid 44 current snap is 36 2024-04-26T02:25:07.516 INFO:tasks.rados.rados.0.smithi175.stdout:340: snap_create 2024-04-26T02:25:07.534 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 44 v 92 (ObjNum 82 snap 8 seq_num 82) dirty exists 2024-04-26T02:25:07.566 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:07.562+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:07.634 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:07.634 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:07.634 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:07.634 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:07.634 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:07.648 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:25:07.667 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:07.667+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:07.769 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:07.763+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:276 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 57.656460019000001, 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015591825, 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.819 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 276 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.820 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158464+0000", 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4240000000000003e-06 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158778+0000", 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031355400000000001 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.821 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158793+0000", 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5654e-05 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158804+0000", 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0543000000000001e-05 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158964+0000", 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015994199999999999 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.822 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.159116+0000", 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152194 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161895+0000", 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027785510000000002 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173835+0000", 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011940014000000001 2024-04-26T02:25:07.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173974+0000", 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000139546 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174052+0000", 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7403000000000004e-05 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.824 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:280 3.1s0 3:8c97d9d7:::smithi17529564-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 57.649401990000001, 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018442278999999999, 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 280 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.825 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165519+0000", 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.826 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165523+0000", 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9400000000000004e-06 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165535+0000", 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2486e-05 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165546+0000", 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.827 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175360+0000", 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098140950000000001 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175447+0000", 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7737000000000004e-05 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179821+0000", 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043734860000000002 2024-04-26T02:25:07.828 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179966+0000", 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014539199999999999 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183960+0000", 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039937430000000001 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:422 3.1s0 3:80641982:::smithi17529564-25:head [copy-from ver 55] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:07.829 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.983182018000001, 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.038918576000000003, 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 422 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.830 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831740+0000", 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5440000000000001e-06 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.831 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831752+0000", 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2041999999999999e-05 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831781+0000", 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8833999999999999e-05 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831794+0000", 2024-04-26T02:25:07.832 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3349e-05 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831860+0000", 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5356000000000002e-05 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.833 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831926+0000", 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6396000000000006e-05 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.859553+0000", 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027626301999999998 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866678+0000", 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007125803 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.834 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870520+0000", 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003841952 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870656+0000", 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013599799999999999 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:423 3.1s0 3:80641982:::smithi17529564-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:07.835 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.983098177000002, 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.034213080999999999, 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 423 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.836 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.837 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831827+0000", 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.792e-06 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831839+0000", 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1712000000000001e-05 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831846+0000", 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9199999999999998e-06 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.838 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832063+0000", 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021765599999999999 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832133+0000", 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9449999999999994e-05 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865896+0000", 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.033763107000000001 2024-04-26T02:25:07.839 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865962+0000", 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5810999999999997e-05 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866035+0000", 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2782999999999998e-05 2024-04-26T02:25:07.840 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:503 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.252212495000002, 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019134271000000001, 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.841 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 503 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.842 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562709+0000", 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1500000000000002e-06 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562720+0000", 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0746e-05 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562740+0000", 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0370999999999999e-05 2024-04-26T02:25:07.843 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562753+0000", 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2561999999999999e-05 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562867+0000", 2024-04-26T02:25:07.844 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113841 2024-04-26T02:25:07.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.845 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:07.845 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562881+0000", 2024-04-26T02:25:07.845 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3709999999999999e-05 2024-04-26T02:25:07.845 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.845 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569080+0000", 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061992339999999996 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569415+0000", 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033499799999999998 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581842+0000", 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012426659 2024-04-26T02:25:07.846 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:504 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.252140101000002, 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020273925000000002, 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.847 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 504 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.848 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562781+0000", 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562797+0000", 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6254000000000001e-05 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562809+0000", 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2204e-05 2024-04-26T02:25:07.849 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562818+0000", 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8459999999999997e-06 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562987+0000", 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016880399999999999 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.850 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:07.851 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562997+0000", 2024-04-26T02:25:07.851 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0713000000000001e-05 2024-04-26T02:25:07.851 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.851 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570438+0000", 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007440894 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570691+0000", 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025249400000000003 2024-04-26T02:25:07.853 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583054+0000", 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012362720000000001 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:505 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.252085923999999, 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.032520136999999998, 2024-04-26T02:25:07.854 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 505 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.855 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562835+0000", 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0200000000000001e-07 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562839+0000", 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5839999999999996e-06 2024-04-26T02:25:07.856 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562853+0000", 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4216000000000001e-05 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562864+0000", 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0579e-05 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563046+0000", 2024-04-26T02:25:07.857 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018216799999999999 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563058+0000", 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1378e-05 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571720+0000", 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086620359999999997 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.858 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571999+0000", 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027927099999999999 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595354+0000", 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023355102999999999 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpRead(3.1s0 59/31 ECSubRead(tid=44, to_read={3:84b104fd:::smithi17529564-9:head=0,36864,0}, subchunks={3:84b104fd:::smithi17529564-9:head=[0,1]}, attrs_to_read=))", 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.243613920999998, 2024-04-26T02:25:07.859 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014360293, 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.860 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571306+0000", 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571606+0000", 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029980300000000002 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.861 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571627+0000", 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1239000000000001e-05 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575588+0000", 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039609429999999998 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585666+0000", 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010078307999999999 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.862 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=45, attrs_read=0))", 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.234646754000003, 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015110926, 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:07.863 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.864 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584305+0000", 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040320649999999996 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584322+0000", 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7076e-05 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.865 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594641+0000", 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010319246000000001 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595384+0000", 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074253899999999996 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:560 3.1s0 3:80641982:::smithi17529564-25:head [append 0~770048] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:07.866 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.252999249999998, 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018860572999999999, 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 560 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.867 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561923+0000", 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9890000000000001e-06 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562755+0000", 2024-04-26T02:25:07.868 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083166800000000003 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562788+0000", 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2960000000000003e-05 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.869 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562804+0000", 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5636000000000001e-05 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562942+0000", 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000138271 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.563116+0000", 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017447599999999999 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.870 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.565388+0000", 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002271295 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574120+0000", 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087317829999999999 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580556+0000", 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006436509 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.871 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580781+0000", 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022498599999999999 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:564 3.1s0 3:80641982:::smithi17529564-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.240786702000001, 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021517379, 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.872 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 564 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:07.873 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574135+0000", 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.689e-06 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574143+0000", 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9270000000000005e-06 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574163+0000", 2024-04-26T02:25:07.874 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0392999999999999e-05 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574183+0000", 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0210000000000001e-05 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581120+0000", 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069366829999999999 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581385+0000", 2024-04-26T02:25:07.875 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026519800000000002 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587167+0000", 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057815389999999996 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587435+0000", 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026854500000000003 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.595650+0000", 2024-04-26T02:25:07.876 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082151949999999998 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:766 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.2005514739999992, 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.031525108000000003, 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.877 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 766 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.878 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614371+0000", 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9469999999999999e-06 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614402+0000", 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1068999999999997e-05 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614436+0000", 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4032000000000002e-05 2024-04-26T02:25:07.879 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614464+0000", 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7484999999999999e-05 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614582+0000", 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118195 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614596+0000", 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4127999999999999e-05 2024-04-26T02:25:07.880 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.618371+0000", 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037749810000000002 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.618590+0000", 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021933799999999999 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645893+0000", 2024-04-26T02:25:07.881 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027302933000000001 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:767 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.2004212449999994, 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.035408467999999998, 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.882 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 767 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.883 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614499+0000", 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4e-07 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614505+0000", 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.49e-06 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614520+0000", 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5119e-05 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.884 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614528+0000", 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4230000000000005e-06 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614744+0000", 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000215942 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614759+0000", 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5075999999999999e-05 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.885 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.621172+0000", 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064126909999999999 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.621439+0000", 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026644700000000001 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.649907+0000", 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028468340000000002 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.886 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:768 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.2003473850000006, 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.039201346999999998, 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:07.887 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 768 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.888 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614573+0000", 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614578+0000", 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.933e-06 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614589+0000", 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1374e-05 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.889 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614598+0000", 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2619999999999998e-06 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614806+0000", 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020866 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614817+0000", 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0992000000000001e-05 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.890 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627773+0000", 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012955250999999999 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.628082+0000", 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000309525 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.653774+0000", 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02569159 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.891 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 91/31 ECSubReadReply(tid=80, attrs_read=0))", 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.1857889680000007, 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016880775000000001, 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.892 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629132+0000", 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0999999999999997e-07 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.893 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630582+0000", 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001450231 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630599+0000", 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7272999999999999e-05 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630616+0000", 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7031e-05 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.894 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631422+0000", 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00080626000000000005 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646012+0000", 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01458917 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:07.895 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.1853874569999991, 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020566872999999999, 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:07.896 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629534+0000", 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6559999999999999e-06 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632692+0000", 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031580739999999999 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632723+0000", 2024-04-26T02:25:07.897 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0953e-05 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632742+0000", 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8702000000000002e-05 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650038+0000", 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017296138999999999 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650099+0000", 2024-04-26T02:25:07.898 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1348999999999998e-05 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 91/31 ECSubReadReply(tid=81, attrs_read=0))", 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.1842793740000008, 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019366189999999998, 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.899 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630641+0000", 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1200000000000002e-07 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.900 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631991+0000", 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001349615 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632006+0000", 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5162e-05 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632049+0000", 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.286e-05 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.901 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646232+0000", 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014183039 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650007+0000", 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037748019999999998 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:07.902 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.631226+0000", 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.1836936359999992, 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014979885, 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631226+0000", 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631226+0000", 2024-04-26T02:25:07.903 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631226+0000", 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631226+0000", 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631279+0000", 2024-04-26T02:25:07.904 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3235000000000001e-05 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631298+0000", 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8459000000000001e-05 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646143+0000", 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014845308 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.905 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646206+0000", 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2883000000000001e-05 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.1828496180000005, 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021746782999999999, 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.906 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632071+0000", 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9999999999999997e-07 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.907 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633377+0000", 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013061100000000001 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633394+0000", 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7255999999999999e-05 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633438+0000", 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4150000000000003e-05 2024-04-26T02:25:07.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650410+0000", 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016971442999999999 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.653817+0000", 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034072239999999999 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.909 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.1813653039999998, 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016622347999999999, 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:07.910 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:07.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.913 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.913 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:07.913 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:07.913 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:07.913 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633555+0000", 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2399999999999996e-07 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635079+0000", 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001523216 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635097+0000", 2024-04-26T02:25:07.914 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8488999999999999e-05 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635142+0000", 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.507e-05 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650125+0000", 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014982733 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650177+0000", 2024-04-26T02:25:07.915 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1916000000000002e-05 2024-04-26T02:25:07.916 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.916 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.916 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.916 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:07.916 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:07.916 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:07.918 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:25:07.918 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:07.912+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:08.018 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:08.012+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:08.087 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:08.087 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:08.087 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:08.087 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:08.101 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:25:08.119 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:08.114+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:08.220 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:08.219+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:08.265 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:08.265 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:08.265 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:08.265 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:08.265 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:08.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:25:08.320 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:08.318+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:08.330 INFO:teuthology.orchestra.run.smithi142.stdout:get_pg_num_history pg_num_history pg_num_history(e94 pg_nums {1={23=1},2={26=8},3={31=16}} deleted_pools ) 2024-04-26T02:25:08.331 INFO:teuthology.orchestra.run.smithi142.stdout:Importing pgid 3.6s1 2024-04-26T02:25:08.331 INFO:teuthology.orchestra.run.smithi142.stdout:Write 1#3:638d7cd2:::smithi17529564-47:11# 2024-04-26T02:25:08.332 INFO:teuthology.orchestra.run.smithi142.stdout:Write 1#3:638d7cd2:::smithi17529564-47:head# 2024-04-26T02:25:08.333 INFO:teuthology.orchestra.run.smithi142.stdout:snapset 11=[]:{11=[10]} 2024-04-26T02:25:08.334 INFO:teuthology.orchestra.run.smithi142.stdout:Write 1#3:67e91997:::smithi17529564-21:20# 2024-04-26T02:25:08.335 INFO:teuthology.orchestra.run.smithi142.stdout:Write 1#3:67e91997:::smithi17529564-21:head# 2024-04-26T02:25:08.335 INFO:teuthology.orchestra.run.smithi142.stdout:snapset 20=[]:{20=[1f,1d,1a,19,10]} 2024-04-26T02:25:08.336 INFO:teuthology.orchestra.run.smithi142.stdout:Write 1#3:687a1e37:::smithi17529564-28:head# 2024-04-26T02:25:08.336 INFO:teuthology.orchestra.run.smithi142.stdout:snapset 9=[]:{} 2024-04-26T02:25:08.338 INFO:teuthology.orchestra.run.smithi142.stdout:write_pg epoch 92 info 3.6s1( v 92'70 (0'0,92'70] local-lis/les=31/32 n=5 ec=31/31 lis/c=31/31 les/c/f=32/32/0 sis=31) 2024-04-26T02:25:08.339 INFO:teuthology.orchestra.run.smithi142.stdout:Import successful 2024-04-26T02:25:08.404 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:262 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.404 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 58.273189635999998, 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013830606, 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 262 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:25:08.405 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127340+0000", 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127341+0000", 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5300000000000004e-07 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127343+0000", 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4399999999999999e-06 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127349+0000", 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2369999999999997e-06 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.127356+0000", 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1600000000000001e-06 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.129990+0000", 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0026331509999999998 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.130041+0000", 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1842999999999998e-05 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138025+0000", 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0079837410000000008 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.138259+0000", 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023420799999999999 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.141171+0000", 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029112729999999998 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.409 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.828600711999997, 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01458187, 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.410 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571929+0000", 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571930+0000", 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.08e-06 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571981+0000", 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0992000000000002e-05 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572011+0000", 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0266000000000001e-05 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572031+0000", 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9380000000000001e-05 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573094+0000", 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010632339999999999 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573112+0000", 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8323000000000001e-05 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586418+0000", 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013305783999999999 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.586511+0000", 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2811000000000003e-05 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 59/31 ECSubWrite(tid=79, reqid=osd.13.0:77, at_version=0'0, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.824444098000001, 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015265225, 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:25:08.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576087+0000", 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.33e-07 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576116+0000", 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9782999999999999e-05 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576138+0000", 2024-04-26T02:25:08.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1696e-05 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576172+0000", 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3872999999999999e-05 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578894+0000", 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002721986 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578918+0000", 2024-04-26T02:25:08.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4042000000000001e-05 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591165+0000", 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012247417 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591351+0000", 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018549500000000001 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 41.824081880000001, 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015022990999999999, 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576450+0000", 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.72e-06 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576517+0000", 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7062000000000003e-05 2024-04-26T02:25:08.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576552+0000", 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5466000000000002e-05 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576573+0000", 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0835999999999998e-05 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576692+0000", 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119474 2024-04-26T02:25:08.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576717+0000", 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5032e-05 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591376+0000", 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014658857000000001 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591471+0000", 2024-04-26T02:25:08.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4543999999999995e-05 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:704 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1212416,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.475570+0000", 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.924959946, 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.040836804999999997, 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:08.423 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475570+0000", 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475570+0000", 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475574+0000", 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1969999999999998e-06 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475596+0000", 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1682e-05 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475646+0000", 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0108000000000002e-05 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475670+0000", 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4414999999999999e-05 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475943+0000", 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027292100000000003 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475966+0000", 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2493e-05 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.490144+0000", 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014178893 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.490327+0000", 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018234800000000001 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.516407+0000", 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.026079748 2024-04-26T02:25:08.427 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:705 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1212416,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.475728+0000", 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.924801952999999, 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.042587364000000003, 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 705 2024-04-26T02:25:08.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475728+0000", 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475728+0000", 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475730+0000", 2024-04-26T02:25:08.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7570000000000001e-06 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475740+0000", 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0409e-05 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475764+0000", 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4352e-05 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475781+0000", 2024-04-26T02:25:08.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7027000000000001e-05 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.476106+0000", 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032499500000000001 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.476123+0000", 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6699000000000001e-05 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509499+0000", 2024-04-26T02:25:08.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.033375828000000003 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509658+0000", 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000158956 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518315+0000", 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086573410000000007 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:706 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1212416,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.475806+0000", 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.924723999999999, 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.051274463999999999, 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475806+0000", 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475806+0000", 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475807+0000", 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2640000000000001e-06 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475817+0000", 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6460000000000005e-06 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475836+0000", 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9249000000000002e-05 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475850+0000", 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3713000000000001e-05 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.477608+0000", 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001758304 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.477622+0000", 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.366e-05 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518443+0000", 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.04082094 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518575+0000", 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013295399999999999 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527080+0000", 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085047339999999999 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 85/31 ECSubWrite(tid=265, reqid=osd.0.0:265, at_version=85'138, trim_to=0'0, roll_forward_to=84'136))", 2024-04-26T02:25:08.437 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.917349228999999, 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020183117, 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:08.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5300000000000004e-07 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491563+0000", 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083815980000000005 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491587+0000", 2024-04-26T02:25:08.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4652999999999999e-05 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491609+0000", 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1322e-05 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491786+0000", 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017765500000000001 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491811+0000", 2024-04-26T02:25:08.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4888999999999998e-05 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.503277+0000", 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011465981 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.503364+0000", 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6465999999999995e-05 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 85/31 ECSubWrite(tid=141, reqid=osd.13.0:141, at_version=85'65, trim_to=0'0, roll_forward_to=83'63))", 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.491036+0000", 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.909493504, 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.036188466000000002, 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491036+0000", 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491036+0000", 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491037+0000", 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491111+0000", 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3520000000000001e-05 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.443 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491135+0000", 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4445000000000001e-05 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491150+0000", 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4617000000000001e-05 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510025+0000", 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018875783 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510050+0000", 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4476000000000001e-05 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527141+0000", 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017090916000000001 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527225+0000", 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3908999999999999e-05 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.445 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 85/31 ECSubWrite(tid=142, reqid=osd.13.0:142, at_version=85'67, trim_to=0'0, roll_forward_to=83'63))", 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.491177+0000", 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.909352844000001, 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.036116522999999998, 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491177+0000", 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491177+0000", 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491178+0000", 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7700000000000004e-07 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491235+0000", 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7688000000000001e-05 2024-04-26T02:25:08.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491257+0000", 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2065e-05 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491276+0000", 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8779000000000001e-05 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.520496+0000", 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029219927999999999 2024-04-26T02:25:08.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.520517+0000", 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1180000000000001e-05 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527238+0000", 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067205839999999999 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527293+0000", 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5522000000000001e-05 2024-04-26T02:25:08.449 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 85/31 ECSubWrite(tid=267, reqid=osd.0.0:267, at_version=85'140, trim_to=0'0, roll_forward_to=84'136))", 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.491710+0000", 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.908819497, 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012879791, 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.450 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491710+0000", 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491710+0000", 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491712+0000", 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.389e-06 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.451 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491758+0000", 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.6144999999999999e-05 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491779+0000", 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1716e-05 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491797+0000", 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7486000000000002e-05 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.452 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495579+0000", 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037818639999999998 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495604+0000", 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5338999999999999e-05 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.504512+0000", 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0089074779999999999 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.453 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.504590+0000", 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8374000000000006e-05 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 85/31 ECSubWrite(tid=259, reqid=osd.6.0:259, at_version=85'86, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.493164+0000", 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.907365285000001, 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016634302, 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.454 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493164+0000", 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493164+0000", 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493165+0000", 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9200000000000002e-07 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.455 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493207+0000", 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1788e-05 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493229+0000", 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2657e-05 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493245+0000", 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5773e-05 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.456 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493398+0000", 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000153289 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493423+0000", 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5119000000000001e-05 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509709+0000", 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016285612000000001 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.457 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509799+0000", 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9672000000000005e-05 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.bs1 85/31 ECSubWrite(tid=47, reqid=osd.7.0:47, at_version=85'37, trim_to=0'0, roll_forward_to=83'35))", 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.494319+0000", 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.906211021000001, 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013509224, 2024-04-26T02:25:08.458 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494319+0000", 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494319+0000", 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.459 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494319+0000", 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4799999999999999e-07 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494356+0000", 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7070000000000003e-05 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494381+0000", 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5035e-05 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.460 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494397+0000", 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6325999999999999e-05 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494552+0000", 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000154461 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494578+0000", 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5805000000000001e-05 2024-04-26T02:25:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.507763+0000", 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013185544 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.507828+0000", 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4634999999999994e-05 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.462 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.6s0 85/31 ECSubReadReply(tid=79, attrs_read=0))", 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.496200+0000", 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.904329395, 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014188353000000001, 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496200+0000", 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.463 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496200+0000", 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496202+0000", 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0899999999999999e-06 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498712+0000", 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025090849999999999 2024-04-26T02:25:08.464 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498742+0000", 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0511e-05 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498759+0000", 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7136e-05 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510330+0000", 2024-04-26T02:25:08.465 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011571266 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510389+0000", 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8264999999999999e-05 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.0s6 85/31 ECSubWrite(tid=65, reqid=osd.1.0:65, at_version=85'51, trim_to=0'0, roll_forward_to=84'49))", 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.496962+0000", 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.903567952, 2024-04-26T02:25:08.466 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021392267999999999, 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496962+0000", 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496962+0000", 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.467 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496963+0000", 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.66e-06 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497015+0000", 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1387000000000001e-05 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497048+0000", 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2975999999999997e-05 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.468 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497069+0000", 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1438999999999999e-05 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497868+0000", 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079878000000000002 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497894+0000", 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6239000000000001e-05 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.469 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518255+0000", 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020360481 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518354+0000", 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9306000000000001e-05 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.6s0 85/31 ECSubReadReply(tid=79, attrs_read=0))", 2024-04-26T02:25:08.470 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.497146+0000", 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.903383557, 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013754308, 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497146+0000", 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497146+0000", 2024-04-26T02:25:08.471 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497148+0000", 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.68e-06 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498310+0000", 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001162541 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.472 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498339+0000", 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8121999999999999e-05 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498358+0000", 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9398999999999998e-05 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510851+0000", 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012493182 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.473 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510900+0000", 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9384e-05 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 85/31 ECSubWrite(tid=260, reqid=osd.6.0:260, at_version=85'88, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.498394+0000", 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.902136019, 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020000166999999999, 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.474 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498394+0000", 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498394+0000", 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498395+0000", 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.393e-06 2024-04-26T02:25:08.475 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498444+0000", 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9088000000000002e-05 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498469+0000", 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4375e-05 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498488+0000", 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9565999999999999e-05 2024-04-26T02:25:08.476 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498724+0000", 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023578299999999999 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498749+0000", 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5089e-05 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518361+0000", 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019611503999999998 2024-04-26T02:25:08.477 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518394+0000", 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3368999999999998e-05 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:742 3.6s0 3:67e91997:::smithi17529564-21:head [append 0~720896] snapc 20=[20,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.540798+0000", 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 10.859732006, 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014839298000000001, 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.478 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 742 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.540798+0000", 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.479 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.540798+0000", 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.540801+0000", 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1080000000000001e-06 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.541841+0000", 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010405729999999999 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.480 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.541880+0000", 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9019e-05 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.541901+0000", 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0199000000000001e-05 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.542072+0000", 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000171368 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:08.481 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.542375+0000", 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030326399999999997 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.545525+0000", 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031498519999999999 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.548885+0000", 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033602469999999998 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.482 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.555387+0000", 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065013880000000003 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.555637+0000", 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025028000000000002 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 92/31 ECSubWrite(tid=309, reqid=client.4589.0:769, at_version=92'163, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:08.483 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.627995+0000", 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.7725347029999998, 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016936414, 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627995+0000", 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627995+0000", 2024-04-26T02:25:08.484 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627996+0000", 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2500000000000005e-07 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.636843+0000", 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088477060000000003 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.636877+0000", 2024-04-26T02:25:08.485 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3855e-05 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.636900+0000", 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2991999999999999e-05 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637023+0000", 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000122767 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.486 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637041+0000", 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7801000000000001e-05 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.644894+0000", 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0078528009999999995 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.644931+0000", 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7867000000000002e-05 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.487 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 92/31 ECSubWrite(tid=314, reqid=client.4589.0:770, at_version=92'168, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.637191+0000", 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.763338418, 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015130242, 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637191+0000", 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.488 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637191+0000", 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637192+0000", 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637532+0000", 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033956299999999997 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.489 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637552+0000", 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0630000000000001e-05 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637568+0000", 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5826000000000001e-05 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.643067+0000", 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054988709999999998 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.490 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.643096+0000", 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8962000000000002e-05 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.652298+0000", 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0092020309999999994 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.652322+0000", 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3609e-05 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.491 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.492 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:08.492 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:08.492 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:08.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:25:08.494 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:25:08.487+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:25:08.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T02:25:08.517 INFO:tasks.rados.rados.0.smithi175.stdout:339: done (1 left) 2024-04-26T02:25:08.517 INFO:tasks.rados.rados.0.smithi175.stdout:340: done (0 left) 2024-04-26T02:25:08.517 INFO:tasks.rados.rados.0.smithi175.stdout:341: rollback oid 20 current snap is 37 2024-04-26T02:25:08.517 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 20 to 34 2024-04-26T02:25:08.517 INFO:tasks.rados.rados.0.smithi175.stdout:342: rollback oid 40 current snap is 37 2024-04-26T02:25:08.517 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 40 to 23 2024-04-26T02:25:08.517 INFO:tasks.rados.rados.0.smithi175.stdout:343: setattr oid 41 current snap is 37 2024-04-26T02:25:08.520 INFO:tasks.rados.rados.0.smithi175.stdout:344: copy_from oid 26 from oid 21 current snap is 37 2024-04-26T02:25:08.520 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 13 current snap is 37 2024-04-26T02:25:08.520 INFO:tasks.rados.rados.0.smithi175.stdout:345: seq_num 145 ranges {2342912=32768} 2024-04-26T02:25:08.560 INFO:tasks.rados.rados.0.smithi175.stdout:345: writing smithi17529564-13 from 2342912 to 2375680 tid 1 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:346: setattr oid 3 current snap is 37 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:342: finishing rollback tid 1 to smithi17529564-40 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 40 v 0 (ObjNum 289 snap 0 seq_num 1) dirty dne 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:341: finishing rollback tid 0 to smithi17529564-20 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:341: finishing rollback tid 1 to smithi17529564-20 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:341: finishing rollback tid 2 to smithi17529564-20 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 20 v 72 (ObjNum 121 snap 22 seq_num 121) dirty exists 2024-04-26T02:25:08.561 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 41 v 202 (ObjNum 111 snap 16 seq_num 111) dirty exists 2024-04-26T02:25:08.562 INFO:tasks.rados.rados.0.smithi175.stdout:341: done (5 left) 2024-04-26T02:25:08.562 INFO:tasks.rados.rados.0.smithi175.stdout:342: done (4 left) 2024-04-26T02:25:08.562 INFO:tasks.rados.rados.0.smithi175.stdout:343: done (3 left) 2024-04-26T02:25:08.562 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 8 current snap is 37 2024-04-26T02:25:08.562 INFO:tasks.rados.rados.0.smithi175.stdout:347: seq_num 146 ranges {3194880=49152} 2024-04-26T02:25:08.594 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:08.591+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:347: writing smithi17529564-8 from 3194880 to 3244032 tid 1 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:348: rollback oid 15 current snap is 37 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 15 to 14 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:344: finishing copy_from racing read to smithi17529564-26 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:344: finishing copy_from to smithi17529564-26 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 26 v 68 (ObjNum 135 snap 31 seq_num 135) dirty exists 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:345: finishing write tid 1 to smithi17529564-13 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:345: finishing write tid 2 to smithi17529564-13 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:345: finishing write tid 3 to smithi17529564-13 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:345: oid 13 updating version 0 to 205 2024-04-26T02:25:08.607 INFO:tasks.rados.rados.0.smithi175.stdout:345: oid 13 version 205 is already newer than 204 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 13 v 205 (ObjNum 145 snap 37 seq_num 145) dirty exists 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:345: left oid 13 (ObjNum 145 snap 37 seq_num 145) 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:344: done (4 left) 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:345: done (3 left) 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:349: copy_from oid 46 from oid 21 current snap is 37 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 3 v 46 (ObjNum 2 snap 0 seq_num 2) dirty exists 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:346: done (3 left) 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:350: copy_from oid 27 from oid 44 current snap is 37 2024-04-26T02:25:08.608 INFO:tasks.rados.rados.0.smithi175.stdout:351: delete oid 34 current snap is 37 2024-04-26T02:25:08.617 INFO:tasks.rados.rados.0.smithi175.stdout:348: finishing rollback tid 0 to smithi17529564-15 2024-04-26T02:25:08.619 INFO:tasks.rados.rados.0.smithi175.stdout:348: finishing rollback tid 1 to smithi17529564-15 2024-04-26T02:25:08.619 INFO:tasks.rados.rados.0.smithi175.stdout:347: finishing write tid 1 to smithi17529564-8 2024-04-26T02:25:08.619 INFO:tasks.rados.rados.0.smithi175.stdout:348: finishing rollback tid 2 to smithi17529564-15 2024-04-26T02:25:08.619 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 15 v 82 (ObjNum 95 snap 12 seq_num 95) dirty exists 2024-04-26T02:25:08.619 INFO:tasks.rados.rados.0.smithi175.stdout:347: finishing write tid 2 to smithi17529564-8 2024-04-26T02:25:08.622 INFO:tasks.rados.rados.0.smithi175.stdout:348: done (4 left) 2024-04-26T02:25:08.622 INFO:tasks.rados.rados.0.smithi175.stdout:351: done (3 left) 2024-04-26T02:25:08.622 INFO:tasks.rados.rados.0.smithi175.stdout:352: read oid 43 snap 36 2024-04-26T02:25:08.623 INFO:tasks.rados.rados.0.smithi175.stdout:352: expect (ObjNum 132 snap 27 seq_num 132) 2024-04-26T02:25:08.624 INFO:tasks.rados.rados.0.smithi175.stdout:353: rmattr oid 49 current snap is 37 2024-04-26T02:25:08.624 INFO:tasks.rados.rados.0.smithi175.stdout:353: done (4 left) 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:354: rollback oid 30 current snap is 37 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 30 to 36 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:347: finishing write tid 3 to smithi17529564-8 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:347: oid 8 updating version 0 to 105 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:347: oid 8 version 105 is already newer than 104 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 8 v 105 (ObjNum 146 snap 37 seq_num 146) dirty exists 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:347: left oid 8 (ObjNum 146 snap 37 seq_num 146) 2024-04-26T02:25:08.625 INFO:tasks.rados.rados.0.smithi175.stdout:347: done (4 left) 2024-04-26T02:25:08.626 INFO:tasks.rados.rados.0.smithi175.stdout:355: copy_from oid 42 from oid 4 current snap is 37 2024-04-26T02:25:08.626 INFO:tasks.rados.rados.0.smithi175.stdout:356: snap_create 2024-04-26T02:25:08.640 INFO:tasks.rados.rados.0.smithi175.stdout:349: finishing copy_from racing read to smithi17529564-46 2024-04-26T02:25:08.641 INFO:tasks.rados.rados.0.smithi175.stdout:355: finishing copy_from racing read to smithi17529564-42 2024-04-26T02:25:08.646 INFO:tasks.rados.rados.0.smithi175.stdout:350: finishing copy_from racing read to smithi17529564-27 2024-04-26T02:25:08.650 INFO:tasks.rados.rados.0.smithi175.stdout:355: finishing copy_from to smithi17529564-42 2024-04-26T02:25:08.650 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 42 v 73 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-04-26T02:25:08.652 INFO:tasks.rados.rados.0.smithi175.stdout:350: finishing copy_from to smithi17529564-27 2024-04-26T02:25:08.652 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 27 v 92 (ObjNum 82 snap 8 seq_num 82) dirty exists 2024-04-26T02:25:08.653 INFO:tasks.rados.rados.0.smithi175.stdout:352: expect (ObjNum 132 snap 27 seq_num 132) 2024-04-26T02:25:08.664 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:08.664 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:25:08.664 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:25:08.664 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:08.679 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:25:08.695 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:25:08.688+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:25:08.781 INFO:tasks.rados.rados.0.smithi175.stdout:354: finishing rollback tid 0 to smithi17529564-30 2024-04-26T02:25:08.781 INFO:tasks.rados.rados.0.smithi175.stdout:349: finishing copy_from to smithi17529564-46 2024-04-26T02:25:08.781 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 46 v 68 (ObjNum 135 snap 31 seq_num 135) dirty exists 2024-04-26T02:25:08.781 INFO:tasks.rados.rados.0.smithi175.stdout:354: finishing rollback tid 1 to smithi17529564-30 2024-04-26T02:25:08.782 INFO:tasks.rados.rados.0.smithi175.stdout:354: finishing rollback tid 2 to smithi17529564-30 2024-04-26T02:25:08.782 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 30 v 114 (ObjNum 104 snap 13 seq_num 104) dirty exists 2024-04-26T02:25:08.795 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:08.788+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:08.800 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:25:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:25:08.800 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:25:08.800 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:08.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:25:08.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /var/log/ceph/exp.3.6s1.14 2024-04-26T02:25:08.930 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:08.927+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:08.938 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:08.938 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:25:08.938 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:252 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.859663206, 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018057229000000001, 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 252 2024-04-26T02:25:08.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071928+0000", 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.940 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071932+0000", 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6830000000000001e-06 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071949+0000", 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.747e-05 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.071991+0000", 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1634999999999997e-05 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072017+0000", 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5732999999999999e-05 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072400+0000", 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00038336099999999998 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072421+0000", 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.1086000000000001e-05 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083152+0000", 2024-04-26T02:25:08.943 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010731001 2024-04-26T02:25:08.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.944 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.944 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.083378+0000", 2024-04-26T02:25:08.944 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00022567 2024-04-26T02:25:08.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.089985+0000", 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00660759 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:253 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.859507221000001, 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018975438000000001, 2024-04-26T02:25:08.946 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 253 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072084+0000", 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072086+0000", 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5629999999999999e-06 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072096+0000", 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0586e-05 2024-04-26T02:25:08.948 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072127+0000", 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0219e-05 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072144+0000", 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7694e-05 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072656+0000", 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000511967 2024-04-26T02:25:08.949 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072677+0000", 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0908999999999999e-05 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.084846+0000", 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012169164 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.950 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.085079+0000", 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000232613 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.091060+0000", 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059807230000000003 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:254 3.fs0 3:ff4c2722:::smithi17529564-35:head [read 0~163840,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.951 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:25:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.85941244, 2024-04-26T02:25:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.02061644, 2024-04-26T02:25:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.952 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.953 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 254 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.954 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072179+0000", 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072180+0000", 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.393e-06 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072190+0000", 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6320000000000003e-06 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.955 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072216+0000", 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5667e-05 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072250+0000", 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4261999999999998e-05 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072786+0000", 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053627299999999998 2024-04-26T02:25:08.956 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.072805+0000", 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8787000000000002e-05 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.086864+0000", 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014058795000000001 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.087018+0000", 2024-04-26T02:25:08.957 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000154492 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.092795+0000", 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057771389999999997 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:287 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~671744] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.745139881999997, 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20982231300000001, 2024-04-26T02:25:08.958 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 287 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.959 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186452+0000", 2024-04-26T02:25:08.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.960 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.960 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.960 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.960 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.186454+0000", 2024-04-26T02:25:08.960 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.599e-06 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188135+0000", 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001681297 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188161+0000", 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5639999999999998e-05 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.961 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188176+0000", 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4696e-05 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188349+0000", 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000173361 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188599+0000", 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00025008099999999998 2024-04-26T02:25:08.962 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.190936+0000", 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0023371910000000002 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.194810+0000", 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0038734189999999999 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:08.963 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396085+0000", 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20127497799999999 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396274+0000", 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000189051 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:288 3.fs0 3:f4c4efcf:::smithi17529564-16:head [append 0~98304] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.743305147000001, 2024-04-26T02:25:08.964 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.208333828, 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 288 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.965 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188286+0000", 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188288+0000", 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8679999999999999e-06 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188377+0000", 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.9355000000000001e-05 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.966 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188412+0000", 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4533000000000003e-05 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188433+0000", 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0662e-05 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192429+0000", 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0039958980000000003 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.967 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.192696+0000", 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026725799999999998 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.193713+0000", 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001017394 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196898+0000", 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0031851710000000001 2024-04-26T02:25:08.968 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396498+0000", 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.19959943599999999 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.396620+0000", 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012225300000000001 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.969 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:289 3.fs0 3:f4c4efcf:::smithi17529564-16:head [setxattr _header (56) in=7b] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.743120052999998, 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.210050292, 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 289 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.970 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.971 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:25:08.971 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.971 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.971 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.971 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188471+0000", 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188473+0000", 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188482+0000", 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1970000000000002e-06 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.972 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188514+0000", 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1452999999999999e-05 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188530+0000", 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6079999999999999e-05 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195465+0000", 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0069355390000000001 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.973 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.195614+0000", 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149087 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196510+0000", 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00089556900000000003 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197757+0000", 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0012469650000000001 2024-04-26T02:25:08.974 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398371+0000", 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.20061418 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.398522+0000", 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015068199999999999 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.975 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:290 3.fs0 3:f4c4efcf:::smithi17529564-16:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 58.743036336000003, 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.212763806, 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.976 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 290 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188555+0000", 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.977 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188556+0000", 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.437e-06 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188563+0000", 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9630000000000001e-06 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188584+0000", 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0262e-05 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.978 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.188603+0000", 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9242999999999999e-05 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.196982+0000", 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.008379226 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.197132+0000", 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000149875 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.979 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399173+0000", 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.202040675 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.399311+0000", 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000138243 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:10.401319+0000", 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020078819999999999 2024-04-26T02:25:08.980 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.981 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.981 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.981 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.981 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.981 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:626 3.fs0 3:fb78ee5b:::smithi17529564-44:11 [read 0~1703936,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-04-26T02:25:08.981 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:41.496798+0000", 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 27.434793173999999, 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018212732999999998, 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.982 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 626 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496798+0000", 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496798+0000", 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.983 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496799+0000", 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.4799999999999999e-07 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496802+0000", 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.782e-06 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496811+0000", 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.5520000000000005e-06 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.496817+0000", 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3459999999999999e-06 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.501473+0000", 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0046553860000000001 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.502604+0000", 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011312270000000001 2024-04-26T02:25:08.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:41.515011+0000", 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.012406992 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:736 3.cs0 3:306ff4be:::smithi17529564-34:head [create,setxattr ZgQgZ]oldhT[\\U_j_l_oPTOabXaUiYaOpqYW^aZS (557) in=40b,setxattr r`pOcqnedhhrlQicQs]fUeqWS_YVtdXtZUp^homP (733) in=40b,setxattr feQtk (138) in=5b,setxattr ZoPosgYbbURWTfUSQ\\^dPqqgsbqpRVehqppWWN\\O (735) in=40b,setxattr XfdZsUWUoggdR\\`lodXaV\\Wcn[cZrYjY[`YSaON[ (839) in=40b,setxattr dh\\\\Thg`dZhga_qUadWQco`ZPtQZ]RlUjYeSYeZX (173) in=40b,setxattr fnsaqh]_oss^agsUQeSYb]cqa]`T]ZrnraYNSSaS (666) in=40b,setxattr QqqkbeUaaqaNmNZjVrUh[TejUTkYZl\\r\\O\\mNe\\a (13472) in=40b,setxattr OUnPieYsQ[flrhgqra[STihRilsPpXNoh]Sggnsc (1013) in=40b,setxattr fNNpPalNaqXesUROsQ`ir`phOTfaNQWWOeWppN[c (5752) in=40b,setxattr cmnZgqaU[VQoaQbtoN]ptNpdfPX\\nbftal_URphi (6736) in=40b,setxattr [Zb`VSVQeeajg\\VjpfQYkXfqVqgbfOokpegkQj\\O (1997) in=40b,setxattr rdX[fTU\\WRZ_ggkW^Uannrqp_UgpRSo``Z]reNpQ (33) in=40b,setxattr R\\cUqjsT]ahOaVflPaTmOSZVbSZ^t]^Q]Tpsg\\OR (1507) in=40b,setxattr TRsb_paV^Uc]^k\\qR_cQ\\edZaTnhc`lYnQ`R[Pnt (1262) in=40b,setxattr YWgng (138) in=5b,setxattr fQQP^sj_Yt_mONkTbRRec^paOpqcdiNUQQoVaopd (1051) in=40b,setxattr `cQhPOlXplq_sRegRYigdio[P`pSTWOhPlpSgabb (1262) in=40b,setxattr YmoXaeVsZ[S^PbnmSRfPiUsjNnXVVZSceXSdeSYN (3084) in=40b,setxattr ssQcfpO`tVqN^hQNib^pV`krVb^a[Pla[gdQ^rgl (10596) in=40b] snapc 20=[20,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:57.481348+0000", 2024-04-26T02:25:08.986 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.450243500999999, 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018610279, 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 736 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481348+0000", 2024-04-26T02:25:08.987 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481348+0000", 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481350+0000", 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.463e-06 2024-04-26T02:25:08.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481529+0000", 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000178586 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481558+0000", 2024-04-26T02:25:08.989 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.9454e-05 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481573+0000", 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4936999999999999e-05 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481701+0000", 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012734399999999999 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.990 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481715+0000", 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4144e-05 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.485354+0000", 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0036391589999999999 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.991 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.992 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.485568+0000", 2024-04-26T02:25:08.992 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000213854 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.487130+0000", 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0015621280000000001 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.495743+0000", 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086128679999999992 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.499891+0000", 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041486200000000004 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.499958+0000", 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.6722000000000003e-05 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.994 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:737 3.cs0 3:38720ec9:::smithi17529564-41:head [append 0~0] snapc 20=[20,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:57.481612+0000", 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.449979620000001, 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020547619999999999, 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 737 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:08.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481612+0000", 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481612+0000", 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481613+0000", 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.1800000000000004e-07 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.996 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481617+0000", 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.3819999999999997e-06 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481632+0000", 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4659e-05 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481639+0000", 2024-04-26T02:25:08.997 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.9929999999999998e-06 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481815+0000", 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017635900000000001 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481828+0000", 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3033999999999999e-05 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:08.998 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.488401+0000", 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065729309999999997 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.488566+0000", 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016469799999999999 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.489467+0000", 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00090169899999999995 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:08.999 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.495755+0000", 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062870679999999998 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.502101+0000", 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063467719999999997 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.000 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.502159+0000", 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8106999999999998e-05 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:738 3.cs0 3:38720ec9:::smithi17529564-41:head [rollback 1a] snapc 20=[20,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:57.481653+0000", 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.449938764000001, 2024-04-26T02:25:09.001 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020630184999999999, 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 738 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.002 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.003 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481653+0000", 2024-04-26T02:25:09.003 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.003 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.003 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.003 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481653+0000", 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481653+0000", 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6300000000000005e-07 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481656+0000", 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7350000000000001e-06 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.004 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481664+0000", 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9719999999999992e-06 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481670+0000", 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0719999999999996e-06 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.005 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481897+0000", 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000227452 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481908+0000", 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0457e-05 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.490644+0000", 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0087357440000000001 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.006 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.490767+0000", 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012367699999999999 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.491603+0000", 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00083540199999999995 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.495757+0000", 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0041541979999999996 2024-04-26T02:25:09.007 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.502231+0000", 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064745840000000002 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.502283+0000", 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1329000000000003e-05 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.008 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:739 3.cs0 3:38720ec9:::smithi17529564-41:head [append 0~0] snapc 20=[20,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:57.481696+0000", 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.44989545, 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020768425, 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 739 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.009 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481696+0000", 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481696+0000", 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481697+0000", 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9999999999999997e-07 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.010 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481700+0000", 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.033e-06 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481708+0000", 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7639999999999994e-06 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481715+0000", 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4069999999999998e-06 2024-04-26T02:25:09.011 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481986+0000", 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00027167000000000001 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481992+0000", 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6500000000000001e-06 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.492472+0000", 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010479677999999999 2024-04-26T02:25:09.012 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.492624+0000", 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015218400000000001 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.493322+0000", 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00069810100000000002 2024-04-26T02:25:09.013 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.496233+0000", 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0029105649999999999 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.502418+0000", 2024-04-26T02:25:09.014 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0061856209999999997 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.502464+0000", 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6152000000000001e-05 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:740 3.cs0 3:384aaf8b:::smithi17529564-13:head [delete] snapc 20=[20,1f,1d,1a,19,10] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90)", 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:57.481724+0000", 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 11.449867490000001, 2024-04-26T02:25:09.015 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.021559787, 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 740 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481724+0000", 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.016 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481724+0000", 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481724+0000", 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6400000000000003e-07 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481727+0000", 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5000000000000002e-06 2024-04-26T02:25:09.017 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481735+0000", 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9270000000000005e-06 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.481741+0000", 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9599999999999997e-06 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.482037+0000", 2024-04-26T02:25:09.018 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00029655799999999999 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.482048+0000", 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0353999999999999e-05 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.493762+0000", 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.011713995 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.019 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.493908+0000", 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00014656700000000001 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.494797+0000", 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00088833399999999996 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.496692+0000", 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0018958759999999999 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.020 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.503237+0000", 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065450209999999998 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:57.503284+0000", 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.6230999999999998e-05 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:758 3.fs0 3:f4c4efcf:::smithi17529564-16:head [stat,delete] snapc 21=[21,20,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e91)", 2024-04-26T02:25:09.021 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:58.606859+0000", 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 10.324732832, 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.017182185999999999, 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 758 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.022 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.606859+0000", 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.606859+0000", 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.606859+0000", 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7999999999999995e-07 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.023 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.024 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.024 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.606864+0000", 2024-04-26T02:25:09.024 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9200000000000003e-06 2024-04-26T02:25:09.024 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.024 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.606875+0000", 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0866000000000001e-05 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.606883+0000", 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7970000000000001e-06 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.607224+0000", 2024-04-26T02:25:09.025 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00034121599999999998 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.607234+0000", 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.8859999999999999e-06 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.617155+0000", 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0099213119999999998 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.026 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.617362+0000", 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020674699999999999 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.618521+0000", 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0011589630000000001 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.621296+0000", 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0027752459999999999 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.027 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.623933+0000", 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0026370030000000002 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:58.624041+0000", 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010755 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:807 3.cs0 3:306ff4be:::smithi17529564-34:head [read 0~1671168,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:25:02.479049+0000", 2024-04-26T02:25:09.028 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.4525425780000001, 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018020033000000001, 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 807 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479049+0000", 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.029 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479049+0000", 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479049+0000", 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.3200000000000005e-07 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479054+0000", 2024-04-26T02:25:09.030 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1740000000000002e-06 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479061+0000", 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.4939999999999997e-06 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479067+0000", 2024-04-26T02:25:09.031 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.0959999999999997e-06 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.482074+0000", 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0030063170000000001 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.482224+0000", 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000150958 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.497069+0000", 2024-04-26T02:25:09.032 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014844362 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:808 3.cs0 3:306ff4be:::smithi17529564-34:head [read 0~1671168,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:25:02.479077+0000", 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.4525140969999999, 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.020856276, 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.033 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 808 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479077+0000", 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479077+0000", 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.034 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.035 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479078+0000", 2024-04-26T02:25:09.035 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2599999999999998e-07 2024-04-26T02:25:09.035 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.035 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.035 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479081+0000", 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4850000000000001e-06 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479089+0000", 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.5730000000000002e-06 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479094+0000", 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.5929999999999996e-06 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.036 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.485477+0000", 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063822660000000002 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.485847+0000", 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000369973 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.499934+0000", 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.014086960000000001 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.037 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:837 3.fs0 3:fb78ee5b:::smithi17529564-44:head [create,setxattr _Ss^S[RR`\\t\\niUg[paOSsfprP`WaQXZRPoaTnZ^ (2592) in=40b,setxattr llPi\\Qdao_dRhgrPtqrih`Rekm]RlaNbX]\\trYVe (1962) in=40b,setxattr bNt_Vqg]SSqUa (1015) in=13b,setxattr _XdkWbhj]`dfsgSZma\\mTnjXiWhoXW_h^P[e^e\\Z (770) in=40b,setxattr RSin_cOOYjpS^Oj (1015) in=15b,setxattr OUpmmR_n[r`sgpPqbOPaa`lNQsQhigadaht]crgn (1013) in=40b,setxattr oNefjbqQQmSpgp`ok_TaagQq]Wa_jrVNe`NTWpTS (666) in=40b,setxattr Z_QbTkQdqSQN`sQVRPlTXSZQjhaqQN]OblrZXfmS (1789) in=40b,setxattr Od^hbNj^^Pbgqceb]qdsO_OsWorYdmkhYXRUZdT_ (1157) in=40b,setxattr Sk^hPZddV\\g[lk`aaUkebjsRNjcabfUZaaUPbf[P (8136) in=40b,setxattr dWXOkSkmofj^]Vaaara`f\\Ph\\[ecnda]mX`hkSQj (18032) in=40b,setxattr l`e_ZRn\\QkrRohhos[VdrsdisYWd][fl\\RapR[Ti (1470) in=40b,setxattr fd[pfiQpZYUqSmadNieqZ]adkeVWNeRP\\TQbhQ_\\ (943) in=40b,setxattr ea[licVmhZYZt_t[nZ_QP]bqqigq]heV^U (1015) in=34b,setxattr lRcgWXhdNaSQZdkVZSZs\\tSNbsrTSN^XjhTt[t_k (523) in=40b,setxattr eU_dqkR]`kjp\\SUtcbgVN`kntrUsfPXPcbtpp[oq (1121) in=40b,setxattr _`UOiYaS[RVtgrPsm_RZfgklYmo`YW\\Yq\\gebhWN (910) in=40b,setxattr RoSNU[ogbeWgNadOhs`ah\\_Tfs`XRj[WXiefUbjq (383) in=40b,setxattr eRjQRaWVVWlaiRjcn\\doocgjakQbccZTf`pe\\cii (66) in=40b,setxattr nesWhieYXZg[QRqgsnppTnNskZt]Rfms^\\RYXTqh (770) in=40b] snapc 25=[24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:25:07.516192+0000", 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 1.4153996529999999, 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.018081204, 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.038 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 837 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516192+0000", 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516192+0000", 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516196+0000", 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.89e-06 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516390+0000", 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00019454800000000001 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516425+0000", 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5193e-05 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.040 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516448+0000", 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3045999999999999e-05 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516603+0000", 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00015493200000000001 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "op must wait for map", 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.516615+0000", 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2065999999999999e-05 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.041 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.523443+0000", 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068271080000000001 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.523711+0000", 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026812500000000003 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.525777+0000", 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.002066226 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.042 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.527639+0000", 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001861726 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.534059+0000", 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0064206539999999996 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:07.534273+0000", 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00021369 2024-04-26T02:25:09.043 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:856 3.cs0 3:3fb4b57b:::smithi17529564-46:head [copy-from ver 68] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:25:08.606258+0000", 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.32533327499999998, 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.045359969, 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.044 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 856 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606258+0000", 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606258+0000", 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.045 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606260+0000", 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0389999999999999e-06 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606269+0000", 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2220000000000008e-06 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606292+0000", 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2717e-05 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.046 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606304+0000", 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1898e-05 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606408+0000", 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000104342 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.047 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606526+0000", 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00011790600000000001 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.635098+0000", 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.028572001 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.641074+0000", 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0059754669999999999 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.048 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.651533+0000", 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.010459520999999999 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.651618+0000", 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4856000000000002e-05 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:857 3.cs0 3:3fb4b57b:::smithi17529564-46:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:09.049 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:25:08.606338+0000", 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.32525327799999998, 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.033488553999999997, 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "started", 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 857 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.050 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606338+0000", 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606338+0000", 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606339+0000", 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5400000000000001e-07 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.051 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606343+0000", 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.777e-06 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606357+0000", 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4053000000000001e-05 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606365+0000", 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.4339999999999992e-06 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.052 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606760+0000", 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00039478899999999999 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.606819+0000", 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.9673000000000003e-05 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.639516+0000", 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.032696018 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.053 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.639625+0000", 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00010937099999999999 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.639827+0000", 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00020178500000000001 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "osd_op(client.4589.0:867 3.cs0 3:3a825099:::smithi17529564-42:head [copy-from ver 73] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:25:08.625090+0000", 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 0.30650113099999998, 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.023448170000000001, 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "client_info": { 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "client": "client.4589", 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "tid": 867 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.055 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625090+0000", 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625090+0000", 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625092+0000", 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.9309999999999998e-06 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.056 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625103+0000", 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0706e-05 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625122+0000", 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8879e-05 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625133+0000", 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1463e-05 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.057 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625197+0000", 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4153999999999996e-05 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "started", 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.625326+0000", 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00012815099999999999 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.627345+0000", 2024-04-26T02:25:09.058 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0020192270000000002 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.640379+0000", 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.013034692000000001 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "commit_sent", 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.648446+0000", 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080668000000000007 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:08.648538+0000", 2024-04-26T02:25:09.059 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2167e-05 2024-04-26T02:25:09.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.060 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.060 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.060 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.060 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:09.062 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:09.059+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:09.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:25:09.162 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:09.159+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:09.194 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:09.194 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:25:09.194 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:25:09.194 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:09.208 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:25:09.263 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:09.263+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:09.335 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:09.335 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:25:09.335 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:25:09.335 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:25:09.335 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:09.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:25:09.364 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:09.363+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:09.466 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:09.464+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:09.472 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 20, 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 600, 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [ 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 55/31 ECSubWrite(tid=91, reqid=client.4589.0:378, at_version=0'0, trim_to=0'0, roll_forward_to=55'33))", 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 46.933746978999999, 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065763030000000004, 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.473 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535116+0000", 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535117+0000", 2024-04-26T02:25:09.474 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.017e-06 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535132+0000", 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5427999999999999e-05 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535149+0000", 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6558e-05 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535156+0000", 2024-04-26T02:25:09.475 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.5930000000000002e-06 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535242+0000", 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.6868999999999998e-05 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.535251+0000", 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1200000000000002e-06 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.541609+0000", 2024-04-26T02:25:09.476 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0063584030000000003 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:22.541692+0000", 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.3314999999999998e-05 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.bs5 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.908840122999997, 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080201519999999991, 2024-04-26T02:25:09.477 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.478 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560023+0000", 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.03e-07 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560055+0000", 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.2001000000000001e-05 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560107+0000", 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.1989e-05 2024-04-26T02:25:09.479 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560123+0000", 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5603e-05 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560425+0000", 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00030192899999999999 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.560439+0000", 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4446e-05 2024-04-26T02:25:09.480 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.567967+0000", 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0075278330000000003 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568043+0000", 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6048000000000001e-05 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.481 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 59/31 ECSubWrite(tid=77, reqid=osd.13.0:77, at_version=59'24, trim_to=0'0, roll_forward_to=58'22))", 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.907739714000002, 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074306329999999999, 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.482 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561123+0000", 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561124+0000", 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.15e-07 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561159+0000", 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.5326e-05 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.483 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561175+0000", 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6483000000000001e-05 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561190+0000", 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4626e-05 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561367+0000", 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000176696 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.484 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561394+0000", 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6991999999999998e-05 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568489+0000", 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070955460000000003 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568554+0000", 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4648999999999997e-05 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.485 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.907636304, 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0074280149999999996, 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.486 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561227+0000", 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.4700000000000001e-07 2024-04-26T02:25:09.487 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561250+0000", 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2586999999999999e-05 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561267+0000", 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.7241e-05 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561278+0000", 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0586e-05 2024-04-26T02:25:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561388+0000", 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000110166 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.561400+0000", 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2553e-05 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568602+0000", 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0072020119999999998 2024-04-26T02:25:09.489 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.568655+0000", 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2222999999999998e-05 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.bs5 59/31 ECSubWrite(tid=32, reqid=osd.7.0:31, at_version=0'0, trim_to=0'0, roll_forward_to=59'21))", 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.889204306000003, 2024-04-26T02:25:09.490 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0089319410000000005, 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579659+0000", 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.491 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579660+0000", 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2020000000000001e-06 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579676+0000", 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6146000000000001e-05 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579695+0000", 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8970999999999998e-05 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.492 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579707+0000", 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2024e-05 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579829+0000", 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000122459 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.579843+0000", 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3869000000000001e-05 2024-04-26T02:25:09.493 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588534+0000", 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0086902950000000007 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588591+0000", 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6975000000000003e-05 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.494 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.0s2 59/31 ECSubWrite(tid=38, reqid=osd.1.0:37, at_version=0'0, trim_to=0'0, roll_forward_to=59'25))", 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.881132885, 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076262750000000001, 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:25:09.495 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587730+0000", 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587731+0000", 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1620000000000001e-06 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587749+0000", 2024-04-26T02:25:09.496 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.791e-05 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587768+0000", 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8657000000000001e-05 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587780+0000", 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2398000000000001e-05 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587901+0000", 2024-04-26T02:25:09.497 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000121264 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.587916+0000", 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4396000000000001e-05 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595298+0000", 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073817470000000001 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595356+0000", 2024-04-26T02:25:09.498 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.8740999999999999e-05 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 59/31 ECSubWrite(tid=137, reqid=osd.12.0:134, at_version=0'0, trim_to=0'0, roll_forward_to=59'52))", 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.880273447, 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0068257600000000002, 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.499 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588589+0000", 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588590+0000", 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2500000000000004e-07 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.500 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588606+0000", 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6001000000000001e-05 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588623+0000", 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6481999999999999e-05 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588635+0000", 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2481e-05 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588726+0000", 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.0257e-05 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.588738+0000", 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1917e-05 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595365+0000", 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006627473 2024-04-26T02:25:09.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.595415+0000", 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0223999999999999e-05 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.2s3 59/31 ECSubWrite(tid=20, reqid=osd.14.0:19, at_version=0'0, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.877552131999998, 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0095002379999999994, 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.503 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591311+0000", 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.504 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591312+0000", 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.13e-06 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591326+0000", 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4403000000000001e-05 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591342+0000", 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5957999999999999e-05 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.505 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591354+0000", 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.184e-05 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591427+0000", 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.2700000000000005e-05 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591437+0000", 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.049e-05 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.506 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600754+0000", 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0093168859999999999 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600811+0000", 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.6830999999999998e-05 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 59/31 ECSubWrite(tid=47, reqid=osd.11.0:47, at_version=59'36, trim_to=0'0, roll_forward_to=58'32))", 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 42.877205511, 2024-04-26T02:25:09.507 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0091052600000000004, 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591657+0000", 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.508 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591658+0000", 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.7199999999999998e-07 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591690+0000", 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1347999999999999e-05 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591703+0000", 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3095000000000001e-05 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.509 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591709+0000", 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 6.7680000000000003e-06 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591781+0000", 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.1532000000000006e-05 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.591793+0000", 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1997000000000001e-05 2024-04-26T02:25:09.510 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600686+0000", 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0088932439999999998 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:26.600763+0000", 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.6503999999999998e-05 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.511 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 60/31 ECSubWrite(tid=138, reqid=client.4589.0:507, at_version=60'54, trim_to=0'0, roll_forward_to=59'52))", 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 41.994088673, 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0067090819999999999, 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.512 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474774+0000", 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474775+0000", 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.39e-07 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.513 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474962+0000", 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00018722500000000001 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.474997+0000", 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.4761999999999997e-05 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475015+0000", 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8153000000000001e-05 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.514 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475211+0000", 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000196627 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.475224+0000", 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2748999999999999e-05 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.515 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481434+0000", 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062096260000000002 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:27.481483+0000", 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9500999999999999e-05 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.0s2 66/31 ECSubWrite(tid=48, reqid=osd.1.0:48, at_version=66'35, trim_to=0'0, roll_forward_to=65'33))", 2024-04-26T02:25:09.516 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.998875730000002, 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0070263529999999999, 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469987+0000", 2024-04-26T02:25:09.517 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.469988+0000", 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0200000000000002e-07 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470012+0000", 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.4773000000000002e-05 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.518 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470027+0000", 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.4894e-05 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470038+0000", 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0991e-05 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471109+0000", 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0010704569999999999 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.519 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471119+0000", 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0332999999999999e-05 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476959+0000", 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0058394240000000002 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477014+0000", 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.4979000000000003e-05 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.520 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.998789430999999, 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007325079, 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.521 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470074+0000", 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2500000000000001e-07 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470115+0000", 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.1431999999999999e-05 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.522 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470129+0000", 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3824e-05 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470138+0000", 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.2439999999999999e-06 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471106+0000", 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00096715899999999999 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.523 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471117+0000", 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1871999999999999e-05 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477371+0000", 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0062540130000000001 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.477399+0000", 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.711e-05 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.524 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.998470244000004, 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0065435570000000002, 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.525 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470393+0000", 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470394+0000", 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.083e-06 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.526 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470435+0000", 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.0899000000000003e-05 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470451+0000", 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.6701000000000002e-05 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.470465+0000", 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3946e-05 2024-04-26T02:25:09.527 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471113+0000", 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00064768499999999995 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.471119+0000", 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7379999999999999e-06 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476885+0000", 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0057667029999999998 2024-04-26T02:25:09.528 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.476936+0000", 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.0801999999999999e-05 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.1s1 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 35.975026643, 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0076064669999999996, 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.529 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493836+0000", 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.530 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493837+0000", 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0049999999999999e-06 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493868+0000", 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.0499999999999999e-05 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493883+0000", 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5404e-05 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.531 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.493894+0000", 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.094e-05 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.494065+0000", 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00017112299999999999 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.494077+0000", 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1402e-05 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.532 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.501400+0000", 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073234449999999996 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:33.501443+0000", 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.2648000000000002e-05 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 71/31 ECSubWrite(tid=104, reqid=client.4589.0:593, at_version=71'34, trim_to=0'0, roll_forward_to=70'32))", 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:38.488278+0000", 2024-04-26T02:25:09.533 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 30.980585128000001, 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0081673049999999997, 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488278+0000", 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488278+0000", 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488279+0000", 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.7000000000000003e-07 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488329+0000", 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.9910999999999997e-05 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488361+0000", 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.1884000000000002e-05 2024-04-26T02:25:09.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488384+0000", 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3356000000000001e-05 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488920+0000", 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00053646100000000001 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.488948+0000", 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7642000000000001e-05 2024-04-26T02:25:09.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.496338+0000", 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073895369999999998 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:38.496445+0000", 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000107544 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.537 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 75/31 ECSubWrite(tid=182, reqid=osd.12.0:182, at_version=75'81, trim_to=0'0, roll_forward_to=74'79))", 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:42.805580+0000", 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.663282846000001, 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066234370000000002, 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805580+0000", 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.538 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805580+0000", 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805582+0000", 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.8500000000000001e-06 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805635+0000", 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.2750999999999997e-05 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.539 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805668+0000", 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.3127999999999999e-05 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805691+0000", 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.2912e-05 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805956+0000", 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00026557000000000002 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.540 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.805983+0000", 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6452999999999999e-05 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.812042+0000", 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0060590949999999996 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.812204+0000", 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016167800000000001 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.541 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.ds1 75/31 ECSubWrite(tid=183, reqid=osd.12.0:183, at_version=75'83, trim_to=0'0, roll_forward_to=74'79))", 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:42.808330+0000", 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 26.660532623000002, 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.007019338, 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808330+0000", 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.542 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808330+0000", 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808332+0000", 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.846e-06 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808390+0000", 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 5.7354e-05 2024-04-26T02:25:09.543 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808426+0000", 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.6081999999999998e-05 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808449+0000", 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.3181999999999999e-05 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808612+0000", 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.00016351500000000001 2024-04-26T02:25:09.544 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.808638+0000", 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.5715999999999999e-05 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.815262+0000", 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0066237739999999998 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:42.815350+0000", 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.7868999999999995e-05 2024-04-26T02:25:09.545 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.as1 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.477263+0000", 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.991599517000001, 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0083101059999999994, 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.546 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477263+0000", 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477263+0000", 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477265+0000", 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0890000000000001e-06 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.547 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477385+0000", 2024-04-26T02:25:09.549 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.000120698 2024-04-26T02:25:09.549 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.549 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.549 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.549 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477406+0000", 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.0758999999999999e-05 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477418+0000", 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.2335e-05 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477497+0000", 2024-04-26T02:25:09.550 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.9170000000000003e-05 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.477508+0000", 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0084999999999999e-05 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485536+0000", 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0080288059999999994 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.551 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485574+0000", 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 3.7163999999999999e-05 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.es3 85/31 ECSubWrite(tid=142, reqid=osd.13.0:142, at_version=85'67, trim_to=0'0, roll_forward_to=83'63))", 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:24:52.485621+0000", 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 16.983241550999999, 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.006879614, 2024-04-26T02:25:09.552 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485621+0000", 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485621+0000", 2024-04-26T02:25:09.553 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485622+0000", 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.5200000000000002e-07 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.554 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485649+0000", 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.6843999999999999e-05 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485660+0000", 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.1626e-05 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.555 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.485670+0000", 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 9.6670000000000008e-06 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.487090+0000", 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.001419547 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.487103+0000", 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.3553999999999999e-05 2024-04-26T02:25:09.556 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.492431+0000", 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0053276210000000003 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:24:52.492501+0000", 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 7.0302999999999994e-05 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.557 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "MOSDECSubOpWrite(3.9s4 95/31 ECSubWrite(tid=168, reqid=osd.13.0:168, at_version=95'60, trim_to=0'0, roll_forward_to=93'56))", 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "initiated_at": "2024-04-26T02:25:02.479950+0000", 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "age": 6.9889133350000003, 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0073332670000000001, 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "continuous": false, 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "type_data": { 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "flag_point": "reached pg", 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "events": [ 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.558 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "initiated", 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479950+0000", 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "header_read", 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479950+0000", 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "throttled", 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479950+0000", 2024-04-26T02:25:09.559 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.47e-07 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "all_read", 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479978+0000", 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 2.7881e-05 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "dispatched", 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479989+0000", 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.0953e-05 2024-04-26T02:25:09.560 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "queued_for_pg", 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.479997+0000", 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 8.1969999999999996e-06 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "reached_pg", 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.483331+0000", 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.0033336559999999999 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.561 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_started", 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.483346+0000", 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 1.5024e-05 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "sub_op_committed", 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.487235+0000", 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 0.003888819 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-26T02:25:09.562 INFO:teuthology.orchestra.run.smithi059.stdout: "event": "done", 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout: "time": "2024-04-26T02:25:02.487283+0000", 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout: "duration": 4.7889999999999997e-05 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-26T02:25:09.563 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:09.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:25:09.566 INFO:tasks.rados.rados.0.smithi175.stdout:349: done (5 left) 2024-04-26T02:25:09.566 INFO:tasks.rados.rados.0.smithi175.stdout:350: done (4 left) 2024-04-26T02:25:09.566 INFO:tasks.rados.rados.0.smithi175.stdout:352: done (3 left) 2024-04-26T02:25:09.566 INFO:tasks.rados.rados.0.smithi175.stdout:354: done (2 left) 2024-04-26T02:25:09.567 INFO:tasks.rados.rados.0.smithi175.stdout:355: done (1 left) 2024-04-26T02:25:09.567 INFO:tasks.rados.rados.0.smithi175.stdout:356: done (0 left) 2024-04-26T02:25:09.567 INFO:tasks.rados.rados.0.smithi175.stdout:357: copy_from oid 47 from oid 19 current snap is 38 2024-04-26T02:25:09.567 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 14 current snap is 38 2024-04-26T02:25:09.567 INFO:tasks.rados.rados.0.smithi175.stdout:358: seq_num 148 ranges {3112960=81920} 2024-04-26T02:25:09.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:25:09.568 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is set 2024-04-26T02:25:09.570 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:09.567+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:09.575 INFO:tasks.rados.rados.0.smithi175.stdout:358: writing smithi17529564-14 from 3112960 to 3194880 tid 1 2024-04-26T02:25:09.575 INFO:tasks.rados.rados.0.smithi175.stdout:359: delete oid 6 current snap is 38 2024-04-26T02:25:09.586 INFO:tasks.rados.rados.0.smithi175.stdout:358: finishing write tid 1 to smithi17529564-14 2024-04-26T02:25:09.586 INFO:tasks.rados.rados.0.smithi175.stdout:358: finishing write tid 2 to smithi17529564-14 2024-04-26T02:25:09.588 INFO:tasks.rados.rados.0.smithi175.stdout:358: finishing write tid 3 to smithi17529564-14 2024-04-26T02:25:09.589 INFO:tasks.rados.rados.0.smithi175.stdout:358: oid 14 updating version 0 to 117 2024-04-26T02:25:09.589 INFO:tasks.rados.rados.0.smithi175.stdout:358: oid 14 version 117 is already newer than 116 2024-04-26T02:25:09.589 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 14 v 117 (ObjNum 148 snap 38 seq_num 148) dirty exists 2024-04-26T02:25:09.589 INFO:tasks.rados.rados.0.smithi175.stdout:358: left oid 14 (ObjNum 148 snap 38 seq_num 148) 2024-04-26T02:25:09.591 INFO:tasks.rados.rados.0.smithi175.stdout:358: done (2 left) 2024-04-26T02:25:09.591 INFO:tasks.rados.rados.0.smithi175.stdout:359: done (1 left) 2024-04-26T02:25:09.591 INFO:tasks.rados.rados.0.smithi175.stdout:360: snap_remove snap 34 2024-04-26T02:25:09.671 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:09.664+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:09.738 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:25:09.738 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:25:09.738 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:09.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:25:09.768 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:25:09.768 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:25:09.771 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:09.766+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:09.789 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:25:09.789 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:25:09.810 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:25:09.810 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:25:09.831 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:25:09.831 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:25:09.847 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:25:09.848 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:25:09.868 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:25:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:25:09.873 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:09.867+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:09.874 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:25:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "complaint_time": 30, 2024-04-26T02:25:09.874 INFO:teuthology.orchestra.run.smithi059.stdout: "num_blocked_ops": 0 2024-04-26T02:25:09.874 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:09.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:25:09.890 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:25:09.890 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:25:09.910 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:25:09.911 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:25:09.929 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:25:09.929 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:25:09.950 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:25:09.951 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:25:09.973 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:09.970+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:09.986 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:25:09.987 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:25:10.023 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:25:10.024 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:25:10.050 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:25:10.050 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:25:10.058 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:10.058 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:10.071 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:25:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:25:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.14 2024-04-26T02:25:10.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:25:10.075 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:10.068+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:10.092 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:25:10.093 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:25:10.096 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T02:25:10.097 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T02:25:10.176 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:25:10.175+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:25:10.211 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:10.211 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:10.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_blocked_ops 2024-04-26T02:25:10.277 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:10.275+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:10.351 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:10.351 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:10.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_historic_ops 2024-04-26T02:25:10.378 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:25:10.376+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:25:10.479 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:10.479+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:10.484 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:10.484 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:10.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:25:10.535 INFO:tasks.rados.rados.0.smithi175.stdout:360: done (1 left) 2024-04-26T02:25:10.535 INFO:tasks.rados.rados.0.smithi175.stdout:361: snap_create 2024-04-26T02:25:10.536 INFO:tasks.rados.rados.0.smithi175.stdout:357: finishing copy_from racing read to smithi17529564-47 2024-04-26T02:25:10.536 INFO:tasks.rados.rados.0.smithi175.stdout:357: finishing copy_from to smithi17529564-47 2024-04-26T02:25:10.536 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 81 (ObjNum 141 snap 32 seq_num 141) dirty exists 2024-04-26T02:25:10.581 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:10.575+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:10.638 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:10.638 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:10.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:25:10.681 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:10.679+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:10.775 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:10.775 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:10.782 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:10.776+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:10.790 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:25:10.883 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:25:10.883+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:25:10.910 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:10.910 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:10.925 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:25:10.985 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:25:10.980+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:25:11.087 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:11.082+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:11.089 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:11.089 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:11.104 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:25:11.187 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:11.182+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:11.222 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:11.222 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:11.236 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:25:11.289 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:11.282+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:11.353 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:11.354 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:11.368 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:25:11.389 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:11.384+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:11.483 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:11.483 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:11.489 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:11.488+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:11.498 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:25:11.544 INFO:tasks.rados.rados.0.smithi175.stdout:357: done (1 left) 2024-04-26T02:25:11.544 INFO:tasks.rados.rados.0.smithi175.stdout:361: done (0 left) 2024-04-26T02:25:11.544 INFO:tasks.rados.rados.0.smithi175.stdout:362: read oid 3 snap 38 2024-04-26T02:25:11.545 INFO:tasks.rados.rados.0.smithi175.stdout:362: expect (ObjNum 2 snap 0 seq_num 2) 2024-04-26T02:25:11.545 INFO:tasks.rados.rados.0.smithi175.stdout:363: setattr oid 10 current snap is 39 2024-04-26T02:25:11.553 INFO:tasks.rados.rados.0.smithi175.stdout:364: read oid 33 snap -1 2024-04-26T02:25:11.554 INFO:tasks.rados.rados.0.smithi175.stdout:364: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:25:11.554 INFO:tasks.rados.rados.0.smithi175.stdout:365: copy_from oid 50 from oid 17 current snap is 39 2024-04-26T02:25:11.554 INFO:tasks.rados.rados.0.smithi175.stdout:366: snap_create 2024-04-26T02:25:11.560 INFO:tasks.rados.rados.0.smithi175.stdout:362: expect (ObjNum 2 snap 0 seq_num 2) 2024-04-26T02:25:11.567 INFO:tasks.rados.rados.0.smithi175.stdout:365: finishing copy_from to smithi17529564-50 2024-04-26T02:25:11.568 INFO:tasks.rados.rados.0.smithi175.stdout:365: got expected ENOENT (src dne) 2024-04-26T02:25:11.568 INFO:tasks.rados.rados.0.smithi175.stdout:365: finishing copy_from racing read to smithi17529564-50 2024-04-26T02:25:11.568 INFO:tasks.rados.rados.0.smithi175.stdout:364: expect (ObjNum 32 snap 0 seq_num 32) 2024-04-26T02:25:11.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T02:25:11.607 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 10 v 39 (ObjNum 9 snap 0 seq_num 9) dirty exists 2024-04-26T02:25:11.617 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:11.614+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:11.617 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:11.617 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:11.632 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:25:11.691 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:11.691+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:11.749 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:11.749 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:11.764 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:25:11.807 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:25:11.807+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:25:11.893 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:11.891+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:11.931 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:11.931 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:11.945 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:25:12.031 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:12.031+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:12.095 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:12.088+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:12.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:25:12.110 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:12.111 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:12.125 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:25:12.196 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:12.195+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:12.258 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:25:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:25:12.278 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:25:12.278 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:25:12.289 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:12.289 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:12.297 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:12.295+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:12.301 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:25:12.301 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:25:12.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:25:12.324 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:25:12.324 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:25:12.341 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:25:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:25:12.361 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:25:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:25:12.379 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:25:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:25:12.399 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:12.394+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:12.400 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:25:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:25:12.418 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:25:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:25:12.435 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:12.436 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:12.436 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:12.436 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:12.439 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:25:12.440 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:25:12.450 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:25:12.460 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:25:12.461 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:25:12.475 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is set 2024-04-26T02:25:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:362: done (4 left) 2024-04-26T02:25:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:363: done (3 left) 2024-04-26T02:25:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:364: done (2 left) 2024-04-26T02:25:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:365: done (1 left) 2024-04-26T02:25:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:366: done (0 left) 2024-04-26T02:25:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 47 current snap is 40 2024-04-26T02:25:12.480 INFO:tasks.rados.rados.0.smithi175.stdout:367: seq_num 150 ranges {6963200=114688} 2024-04-26T02:25:12.483 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:25:12.483 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:25:12.500 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:12.495+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:12.508 INFO:teuthology.orchestra.run.smithi059.stdout:osd.12: {} 2024-04-26T02:25:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:osd.12: osd_enable_op_tracker = '' 2024-04-26T02:25:12.529 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:25:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:25:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.14 2024-04-26T02:25:12.550 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:25:12.551 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:25:12.555 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T02:25:12.555 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T02:25:12.569 INFO:tasks.rados.rados.0.smithi175.stdout:367: writing smithi17529564-47 from 6963200 to 7077888 tid 1 2024-04-26T02:25:12.569 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 48 current snap is 40 2024-04-26T02:25:12.569 INFO:tasks.rados.rados.0.smithi175.stdout:368: seq_num 151 ranges {2211840=131072} 2024-04-26T02:25:12.575 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:12.575 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:12.575 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:12.575 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:12.575 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:12.586 INFO:tasks.rados.rados.0.smithi175.stdout:368: writing smithi17529564-48 from 2211840 to 2342912 tid 1 2024-04-26T02:25:12.586 INFO:tasks.rados.rados.0.smithi175.stdout:369: read oid 35 snap -1 2024-04-26T02:25:12.586 INFO:tasks.rados.rados.0.smithi175.stdout:369: expect deleted 2024-04-26T02:25:12.586 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 9 current snap is 40 2024-04-26T02:25:12.586 INFO:tasks.rados.rados.0.smithi175.stdout:370: seq_num 152 ranges {147456=147456} 2024-04-26T02:25:12.588 INFO:tasks.rados.rados.0.smithi175.stdout:370: writing smithi17529564-9 from 147456 to 294912 tid 1 2024-04-26T02:25:12.588 INFO:tasks.rados.rados.0.smithi175.stdout:371: delete oid 43 current snap is 40 2024-04-26T02:25:12.588 INFO:tasks.rados.rados.0.smithi175.stdout:367: finishing write tid 1 to smithi17529564-47 2024-04-26T02:25:12.588 INFO:tasks.rados.rados.0.smithi175.stdout:367: finishing write tid 2 to smithi17529564-47 2024-04-26T02:25:12.590 INFO:tasks.rados.rados.0.smithi175.stdout:367: finishing write tid 3 to smithi17529564-47 2024-04-26T02:25:12.590 INFO:tasks.rados.rados.0.smithi175.stdout:367: oid 47 updating version 0 to 82 2024-04-26T02:25:12.590 INFO:tasks.rados.rados.0.smithi175.stdout:367: oid 47 updating version 82 to 83 2024-04-26T02:25:12.590 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 47 v 83 (ObjNum 150 snap 40 seq_num 150) dirty exists 2024-04-26T02:25:12.590 INFO:tasks.rados.rados.0.smithi175.stdout:367: left oid 47 (ObjNum 150 snap 40 seq_num 150) 2024-04-26T02:25:12.593 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:25:12.597 INFO:tasks.rados.rados.0.smithi175.stdout:368: finishing write tid 1 to smithi17529564-48 2024-04-26T02:25:12.599 INFO:tasks.rados.rados.0.smithi175.stdout:368: finishing write tid 2 to smithi17529564-48 2024-04-26T02:25:12.601 INFO:tasks.rados.rados.0.smithi175.stdout:367: done (4 left) 2024-04-26T02:25:12.601 INFO:tasks.rados.rados.0.smithi175.stdout:369: done (3 left) 2024-04-26T02:25:12.601 INFO:tasks.rados.rados.0.smithi175.stdout:371: done (2 left) 2024-04-26T02:25:12.601 INFO:tasks.rados.rados.0.smithi175.stdout:372: read oid 37 snap 38 2024-04-26T02:25:12.601 INFO:tasks.rados.rados.0.smithi175.stdout:372: expect (ObjNum 143 snap 34 seq_num 143) 2024-04-26T02:25:12.601 INFO:tasks.rados.rados.0.smithi175.stdout:373: rmattr oid 38 current snap is 40 2024-04-26T02:25:12.601 INFO:tasks.rados.rados.0.smithi175.stdout:374: delete oid 13 current snap is 40 2024-04-26T02:25:12.602 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:12.599+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:12.602 INFO:tasks.rados.rados.0.smithi175.stdout:370: finishing write tid 1 to smithi17529564-9 2024-04-26T02:25:12.602 INFO:tasks.rados.rados.0.smithi175.stdout:370: finishing write tid 2 to smithi17529564-9 2024-04-26T02:25:12.606 INFO:tasks.rados.rados.0.smithi175.stdout:370: finishing write tid 3 to smithi17529564-9 2024-04-26T02:25:12.606 INFO:tasks.rados.rados.0.smithi175.stdout:370: oid 9 updating version 0 to 73 2024-04-26T02:25:12.606 INFO:tasks.rados.rados.0.smithi175.stdout:370: oid 9 version 73 is already newer than 72 2024-04-26T02:25:12.606 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 9 v 73 (ObjNum 152 snap 40 seq_num 152) dirty exists 2024-04-26T02:25:12.606 INFO:tasks.rados.rados.0.smithi175.stdout:370: left oid 9 (ObjNum 152 snap 40 seq_num 152) 2024-04-26T02:25:12.607 INFO:tasks.rados.rados.0.smithi175.stdout:370: done (4 left) 2024-04-26T02:25:12.607 INFO:tasks.rados.rados.0.smithi175.stdout:374: done (3 left) 2024-04-26T02:25:12.607 INFO:tasks.rados.rados.0.smithi175.stdout:375: delete oid 42 current snap is 40 2024-04-26T02:25:12.614 INFO:tasks.rados.rados.0.smithi175.stdout:368: finishing write tid 3 to smithi17529564-48 2024-04-26T02:25:12.614 INFO:tasks.rados.rados.0.smithi175.stdout:368: oid 48 updating version 0 to 56 2024-04-26T02:25:12.614 INFO:tasks.rados.rados.0.smithi175.stdout:368: oid 48 version 56 is already newer than 55 2024-04-26T02:25:12.614 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 48 v 56 (ObjNum 151 snap 40 seq_num 151) dirty exists 2024-04-26T02:25:12.614 INFO:tasks.rados.rados.0.smithi175.stdout:368: left oid 48 (ObjNum 151 snap 40 seq_num 151) 2024-04-26T02:25:12.614 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 38 v 86 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-04-26T02:25:12.615 INFO:tasks.rados.rados.0.smithi175.stdout:368: done (3 left) 2024-04-26T02:25:12.615 INFO:tasks.rados.rados.0.smithi175.stdout:373: done (2 left) 2024-04-26T02:25:12.615 INFO:tasks.rados.rados.0.smithi175.stdout:375: done (1 left) 2024-04-26T02:25:12.616 INFO:tasks.rados.rados.0.smithi175.stdout:376: copy_from oid 14 from oid 35 current snap is 40 2024-04-26T02:25:12.616 INFO:tasks.rados.rados.0.smithi175.stdout:377: read oid 12 snap 36 2024-04-26T02:25:12.616 INFO:tasks.rados.rados.0.smithi175.stdout:377: expect deleted 2024-04-26T02:25:12.616 INFO:tasks.rados.rados.0.smithi175.stdout:378: read oid 17 snap -1 2024-04-26T02:25:12.616 INFO:tasks.rados.rados.0.smithi175.stdout:378: expect deleted 2024-04-26T02:25:12.616 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 41 current snap is 40 2024-04-26T02:25:12.616 INFO:tasks.rados.rados.0.smithi175.stdout:379: seq_num 156 ranges {2555904=229376} 2024-04-26T02:25:12.639 INFO:tasks.rados.rados.0.smithi175.stdout:379: writing smithi17529564-41 from 2555904 to 2785280 tid 1 2024-04-26T02:25:12.640 INFO:tasks.rados.rados.0.smithi175.stdout:380: setattr oid 34 current snap is 40 2024-04-26T02:25:12.640 INFO:tasks.rados.rados.0.smithi175.stdout:372: expect (ObjNum 143 snap 34 seq_num 143) 2024-04-26T02:25:12.703 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:12.698+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:12.766 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:12.766 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:12.766 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:12.766 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:12.766 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.729476253000001, 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075357569999999997, 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.767 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.768 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033385+0000", 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4e-07 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033444+0000", 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9450999999999997e-05 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033476+0000", 2024-04-26T02:25:12.769 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1979e-05 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033497+0000", 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0616999999999999e-05 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033684+0000", 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018750700000000001 2024-04-26T02:25:12.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033709+0000", 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4912000000000001e-05 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040833+0000", 2024-04-26T02:25:12.771 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071240510000000002 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040919+0000", 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6399999999999999e-05 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.772 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.728577552000004, 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010955845000000001, 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034285+0000", 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8669999999999998e-06 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.774 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034349+0000", 2024-04-26T02:25:12.775 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4090999999999993e-05 2024-04-26T02:25:12.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.775 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.775 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.775 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034386+0000", 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6511999999999999e-05 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034409+0000", 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3198999999999999e-05 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035470+0000", 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001061195 2024-04-26T02:25:12.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035486+0000", 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5699999999999999e-05 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045121+0000", 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096354679999999995 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.777 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045238+0000", 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011681299999999999 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.724185571999996, 2024-04-26T02:25:12.778 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077721719999999999, 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.779 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038675+0000", 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.780 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038732+0000", 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024999999999997e-05 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038765+0000", 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2325e-05 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.781 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038789+0000", 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4905999999999998e-05 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039037+0000", 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024744900000000001 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.782 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039062+0000", 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4719000000000002e-05 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046357+0000", 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072952980000000004 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.783 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046447+0000", 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9690000000000004e-05 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.711644526000001, 2024-04-26T02:25:12.784 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067178699999999999, 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.785 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051217+0000", 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0099999999999998e-06 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051246+0000", 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8345999999999999e-05 2024-04-26T02:25:12.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051275+0000", 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8921999999999999e-05 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051313+0000", 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7991999999999998e-05 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051640+0000", 2024-04-26T02:25:12.787 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032731600000000002 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051665+0000", 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4729e-05 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057825+0000", 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061603889999999996 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.788 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057933+0000", 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010816599999999999 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.727711420000006, 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018386527999999999, 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.789 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.790 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035150+0000", 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9230000000000001e-06 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035236+0000", 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5860999999999997e-05 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035280+0000", 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3810999999999998e-05 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.791 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035303+0000", 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3223000000000001e-05 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035450+0000", 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014687200000000001 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035475+0000", 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4623000000000001e-05 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.792 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053426+0000", 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017950875000000002 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053535+0000", 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010933999999999999 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.793 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.721033319, 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012671968, 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.794 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041874+0000", 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6728999999999999e-05 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.795 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041914+0000", 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0312000000000003e-05 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041939+0000", 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4116000000000001e-05 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042110+0000", 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000171094 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.796 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042135+0000", 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.493e-05 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054408+0000", 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012273386000000001 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.797 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054499+0000", 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0650999999999997e-05 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 66.716427926999998, 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082587159999999993, 2024-04-26T02:25:12.798 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.799 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046434+0000", 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.193e-06 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046463+0000", 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046509+0000", 2024-04-26T02:25:12.800 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6078000000000002e-05 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046565+0000", 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6048999999999998e-05 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046730+0000", 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165408 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.801 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046747+0000", 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6353000000000001e-05 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054637+0000", 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078899409999999993 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.802 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054691+0000", 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4200999999999998e-05 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 46.203876622000003, 2024-04-26T02:25:12.803 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014202093000000001, 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.804 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558985+0000", 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.807e-06 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.805 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559023+0000", 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7985999999999998e-05 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559047+0000", 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4032999999999998e-05 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559062+0000", 2024-04-26T02:25:12.806 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5082999999999999e-05 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559703+0000", 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064080699999999997 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559728+0000", 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4851999999999999e-05 2024-04-26T02:25:12.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573054+0000", 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013325590999999999 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573185+0000", 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131934 2024-04-26T02:25:12.808 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 46.202342403000003, 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079052459999999995, 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.809 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.810 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560592+0000", 2024-04-26T02:25:12.811 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4134999999999994e-05 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560624+0000", 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1325999999999998e-05 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560647+0000", 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:25:12.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560875+0000", 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022790500000000001 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560900+0000", 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5420000000000001e-05 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.813 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568320+0000", 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074198320000000003 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568423+0000", 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102675 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 46.195210154000002, 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084963339999999995, 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.815 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.816 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567651+0000", 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567703+0000", 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2142000000000003e-05 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.817 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567774+0000", 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1445000000000005e-05 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567813+0000", 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9026000000000002e-05 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.818 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568266+0000", 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045321000000000001 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568294+0000", 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.743e-05 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576057+0000", 2024-04-26T02:25:12.819 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077626329999999997 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576146+0000", 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9648000000000006e-05 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.820 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 46.194987556000001, 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014301641, 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.821 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567874+0000", 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.19e-06 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.822 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567930+0000", 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6505999999999997e-05 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567966+0000", 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5441999999999997e-05 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567986+0000", 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0086999999999999e-05 2024-04-26T02:25:12.823 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569871+0000", 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001885751 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569896+0000", 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4369e-05 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.824 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582080+0000", 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012184133999999999 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582174+0000", 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4161999999999997e-05 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 66/31 ECSubWrite(tid=77, reqid=osd.15.0:77, at_version=66'60, trim_to=0'0, roll_forward_to=65'58))", 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:12.825 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 39.291558565999999, 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082262370000000008, 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471302+0000", 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2099999999999998e-07 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471322+0000", 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0667000000000001e-05 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471336+0000", 2024-04-26T02:25:12.827 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.348e-05 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471346+0000", 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6739999999999992e-06 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471519+0000", 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017380499999999999 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.828 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471534+0000", 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479481+0000", 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079467189999999997 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.829 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479528+0000", 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7051000000000001e-05 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=50, reqid=client.4589.0:655, at_version=80'37, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.236720078000001, 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093202319999999995, 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.830 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.831 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526141+0000", 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527110+0000", 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096976099999999997 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527145+0000", 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4860000000000002e-05 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.832 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527170+0000", 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5191999999999999e-05 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527416+0000", 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024589499999999999 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527442+0000", 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6013e-05 2024-04-26T02:25:12.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535371+0000", 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079284000000000004 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535460+0000", 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9450999999999994e-05 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.834 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=51, reqid=client.4589.0:656, at_version=80'38, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 25.231588727999998, 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070853160000000004, 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.835 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531274+0000", 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.497e-06 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531789+0000", 2024-04-26T02:25:12.836 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00051518199999999999 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531821+0000", 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2305999999999999e-05 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531844+0000", 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.837 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532644+0000", 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00080051600000000003 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532671+0000", 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6588999999999999e-05 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.838 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538264+0000", 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055933129999999999 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538357+0000", 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2571000000000005e-05 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.839 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 85/31 ECSubWrite(tid=143, reqid=osd.13.0:143, at_version=85'52, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.272568898999999, 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010592577000000001, 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.840 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.841 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490292+0000", 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490349+0000", 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6829000000000001e-05 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490671+0000", 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032284000000000002 2024-04-26T02:25:12.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490754+0000", 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2491999999999996e-05 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490891+0000", 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013744699999999999 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490917+0000", 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6089e-05 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500787+0000", 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098697860000000002 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.844 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500884+0000", 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6403999999999994e-05 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 85/31 ECSubWrite(tid=144, reqid=osd.13.0:144, at_version=85'54, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.267495808, 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073014530000000003, 2024-04-26T02:25:12.845 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495366+0000", 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1600000000000001e-06 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495422+0000", 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6128999999999997e-05 2024-04-26T02:25:12.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498136+0000", 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027135340000000001 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498169+0000", 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2876000000000002e-05 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498749+0000", 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058028799999999998 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498775+0000", 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6270000000000001e-05 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502568+0000", 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037923409999999999 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502666+0000", 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7855000000000004e-05 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 90/31 ECSubWrite(tid=295, reqid=client.4589.0:741, at_version=90'70, trim_to=0'0, roll_forward_to=85'68))", 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 15.252542972000001, 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079796829999999996, 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510318+0000", 2024-04-26T02:25:12.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3030000000000001e-06 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510402+0000", 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3401999999999999e-05 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510440+0000", 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8145999999999997e-05 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510469+0000", 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9212000000000001e-05 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510747+0000", 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027817899999999998 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510779+0000", 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2189e-05 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.518251+0000", 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007471648 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.518297+0000", 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5603999999999999e-05 2024-04-26T02:25:12.855 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 95/31 ECSubWrite(tid=96, reqid=osd.8.0:96, at_version=95'73, trim_to=0'0, roll_forward_to=92'71))", 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.276148604999999, 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079293969999999995, 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.856 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:12.857 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486712+0000", 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3000000000000001e-07 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486765+0000", 2024-04-26T02:25:12.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3492000000000002e-05 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486791+0000", 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6077000000000001e-05 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486814+0000", 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2762e-05 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486947+0000", 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013290200000000001 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486962+0000", 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5102999999999999e-05 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.494547+0000", 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007584833 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.494641+0000", 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3797999999999999e-05 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 101/31 ECSubWrite(tid=177, reqid=client.4589.0:858, at_version=101'68, trim_to=0'0, roll_forward_to=100'66))", 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:08.638933+0000", 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 4.1239264960000002, 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010194929, 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.638933+0000", 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.638933+0000", 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.638934+0000", 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3e-07 2024-04-26T02:25:12.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642286+0000", 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003351307 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642315+0000", 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9522999999999998e-05 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642331+0000", 2024-04-26T02:25:12.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5447e-05 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642471+0000", 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014026500000000001 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642491+0000", 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0088000000000001e-05 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.649054+0000", 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006563564 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.649128+0000", 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4004999999999994e-05 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 102/95 ECSubWrite(tid=96, reqid=client.4589.0:870, at_version=102'72, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:25:12.865 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:09.603584+0000", 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 3.1592761340000002, 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014601332, 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.603584+0000", 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.603584+0000", 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.603585+0000", 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7600000000000006e-07 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610305+0000", 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067199080000000001 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:12.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610333+0000", 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8459999999999999e-05 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610350+0000", 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7163000000000002e-05 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610463+0000", 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112345 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610478+0000", 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.556e-05 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.618105+0000", 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076268179999999996 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.618185+0000", 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0102e-05 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.869 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.870 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:12.870 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:12.870 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:376: finishing copy_from to smithi17529564-14 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:376: got expected ENOENT (src dne) 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:376: finishing copy_from racing read to smithi17529564-14 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:379: finishing write tid 1 to smithi17529564-41 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:379: finishing write tid 2 to smithi17529564-41 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:379: finishing write tid 3 to smithi17529564-41 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:379: oid 41 updating version 0 to 228 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:379: oid 41 version 228 is already newer than 227 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 41 v 228 (ObjNum 156 snap 40 seq_num 156) dirty exists 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:379: left oid 41 (ObjNum 156 snap 40 seq_num 156) 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:372: done (5 left) 2024-04-26T02:25:12.872 INFO:tasks.rados.rados.0.smithi175.stdout:376: done (4 left) 2024-04-26T02:25:12.873 INFO:tasks.rados.rados.0.smithi175.stdout:377: done (3 left) 2024-04-26T02:25:12.873 INFO:tasks.rados.rados.0.smithi175.stdout:378: done (2 left) 2024-04-26T02:25:12.873 INFO:tasks.rados.rados.0.smithi175.stdout:379: done (1 left) 2024-04-26T02:25:12.873 INFO:tasks.rados.rados.0.smithi175.stdout:381: snap_remove snap 36 2024-04-26T02:25:12.873 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:12.868+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:12.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:25:12.972 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:12.971+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:13.001 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:13.001 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:13.001 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:13.001 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:13.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:25:13.073 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:13.070+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:13.138 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:13.138 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:13.139 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:13.139 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:13.152 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:25:13.198 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:13.195+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.348503109000006, 2024-04-26T02:25:13.269 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.073984011000000002, 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918606+0000", 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.396e-06 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918620+0000", 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918641+0000", 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0389000000000001e-05 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918657+0000", 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6671999999999999e-05 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918805+0000", 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014724900000000001 2024-04-26T02:25:13.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918819+0000", 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4453e-05 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.273 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.988816+0000", 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069997045999999993 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989070+0000", 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025383399999999998 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989371+0000", 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030080500000000002 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.274 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.990597+0000", 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012262740000000001 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992421+0000", 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001824132 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992517+0000", 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5880999999999999e-05 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.275 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992587+0000", 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0359999999999997e-05 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 85.111785702999995, 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017505889, 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.276 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 88 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155322+0000", 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155328+0000", 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2700000000000001e-06 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155358+0000", 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0624999999999999e-05 2024-04-26T02:25:13.278 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155373+0000", 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4229999999999999e-05 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.162973+0000", 2024-04-26T02:25:13.279 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076001050000000002 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163128+0000", 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015489200000000001 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163377+0000", 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024957100000000003 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.280 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.165420+0000", 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020422349999999999 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172717+0000", 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072976839999999996 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172781+0000", 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3910000000000003e-05 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.281 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172827+0000", 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5587000000000002e-05 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.940399608000007, 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018318649999999999, 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.282 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 114 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:13.283 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326708+0000", 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9700000000000005e-07 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326713+0000", 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326722+0000", 2024-04-26T02:25:13.284 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9199999999999993e-06 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326729+0000", 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1489999999999997e-06 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339956+0000", 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013227153 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340087+0000", 2024-04-26T02:25:13.285 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130946 2024-04-26T02:25:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340294+0000", 2024-04-26T02:25:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206434 2024-04-26T02:25:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.286 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344052+0000", 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037581490000000001 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344900+0000", 2024-04-26T02:25:13.287 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084779500000000004 2024-04-26T02:25:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344967+0000", 2024-04-26T02:25:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607000000000005e-05 2024-04-26T02:25:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.288 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345026+0000", 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8146999999999997e-05 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.289 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.940366725999993, 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019222108000000002, 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 115 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.290 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0399999999999995e-07 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.291 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326874+0000", 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013342599999999999 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326885+0000", 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1323e-05 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326893+0000", 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7659999999999998e-06 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.292 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342112+0000", 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015218537000000001 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342342+0000", 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023057199999999999 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342691+0000", 2024-04-26T02:25:13.293 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034918900000000002 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345831+0000", 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031394740000000002 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345848+0000", 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7686e-05 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.294 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345912+0000", 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3709999999999998e-05 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345962+0000", 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9721e-05 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.940196055000001, 2024-04-26T02:25:13.295 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019714167000000001, 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 116 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.296 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326911+0000", 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326924+0000", 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2743e-05 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.297 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326934+0000", 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5459999999999997e-06 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326941+0000", 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1470000000000004e-06 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344124+0000", 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017183085000000001 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.298 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344238+0000", 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114591 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344425+0000", 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018710800000000001 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345974+0000", 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001548979 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.299 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346498+0000", 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052335399999999996 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346570+0000", 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1983000000000005e-05 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.300 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346625+0000", 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4843999999999999e-05 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.940154062999994, 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020133699000000001, 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.301 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 117 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.302 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326953+0000", 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326959+0000", 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.823e-06 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.303 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326968+0000", 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9530000000000005e-06 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326979+0000", 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1289e-05 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345091+0000", 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018111505999999999 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.304 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345217+0000", 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012587399999999999 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345409+0000", 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019226700000000001 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346352+0000", 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00094280000000000004 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.305 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346964+0000", 2024-04-26T02:25:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061192899999999999 2024-04-26T02:25:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347036+0000", 2024-04-26T02:25:13.306 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2120999999999996e-05 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347086+0000", 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0377000000000002e-05 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.775429376000005, 2024-04-26T02:25:13.308 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018319485, 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 139 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.309 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491678+0000", 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.333e-06 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491688+0000", 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9299999999999998e-06 2024-04-26T02:25:13.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491707+0000", 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8281999999999999e-05 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491720+0000", 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3502e-05 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504966+0000", 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013245808 2024-04-26T02:25:13.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505190+0000", 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000223876 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505520+0000", 2024-04-26T02:25:13.312 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032999 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508527+0000", 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030072739999999999 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509751+0000", 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012241719999999999 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.313 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509880+0000", 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128687 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509997+0000", 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116631 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:13.314 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.775366199999993, 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018559454, 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 140 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491742+0000", 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.404e-06 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.316 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491946+0000", 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204086 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491967+0000", 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1049000000000001e-05 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491983+0000", 2024-04-26T02:25:13.317 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6356000000000001e-05 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507052+0000", 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015069173 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507208+0000", 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000155783 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.318 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507411+0000", 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020306 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510024+0000", 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026129 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510123+0000", 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8667999999999998e-05 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.319 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510230+0000", 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107565 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510300+0000", 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9410000000000001e-05 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.320 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.775095175999994, 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018767703, 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 141 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.321 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492013+0000", 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.322 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492039+0000", 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5952000000000002e-05 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492058+0000", 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9215000000000002e-05 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492082+0000", 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4379000000000002e-05 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.323 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508623+0000", 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016540947 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508846+0000", 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022293599999999999 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509201+0000", 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035443900000000001 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.324 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510580+0000", 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013797379999999999 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510627+0000", 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6254000000000001e-05 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510715+0000", 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8215999999999997e-05 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.325 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510779+0000", 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4136999999999999e-05 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.464243245000006, 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018162602999999999, 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.326 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 186 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.327 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802865+0000", 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.666e-06 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802876+0000", 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1246e-05 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802898+0000", 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1645999999999999e-05 2024-04-26T02:25:13.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802923+0000", 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5389e-05 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.815977+0000", 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013053301 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816115+0000", 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138553 2024-04-26T02:25:13.329 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816319+0000", 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204236 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820746+0000", 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044270739999999996 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820868+0000", 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122127 2024-04-26T02:25:13.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820949+0000", 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0395999999999994e-05 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821026+0000", 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6969000000000001e-05 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.331 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.464157815999997, 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018225614000000001, 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 187 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.332 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802950+0000", 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.333 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802963+0000", 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3206e-05 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802982+0000", 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8519e-05 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803002+0000", 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0162000000000001e-05 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.334 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816937+0000", 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013934867 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817068+0000", 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130734 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817285+0000", 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000217209 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.335 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820849+0000", 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035643160000000001 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821038+0000", 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000188767 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821122+0000", 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4243e-05 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.336 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821174+0000", 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2181000000000001e-05 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.464061594, 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018460061999999999, 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.337 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 188 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.338 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803046+0000", 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4500000000000001e-06 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803180+0000", 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013367300000000001 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803201+0000", 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1399e-05 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.339 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803217+0000", 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5556000000000001e-05 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818151+0000", 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014934374 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818319+0000", 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016765500000000001 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818541+0000", 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022229899999999999 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821196+0000", 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002654965 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821379+0000", 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018284400000000001 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821453+0000", 2024-04-26T02:25:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3546000000000004e-05 2024-04-26T02:25:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821505+0000", 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2301e-05 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 84.463861707999996, 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018840794000000001, 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.343 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.344 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803246+0000", 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803257+0000", 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0825999999999999e-05 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.345 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803275+0000", 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8099999999999999e-05 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803288+0000", 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2595999999999999e-05 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819675+0000", 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016387184999999999 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.346 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819800+0000", 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012490999999999999 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820077+0000", 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000277533 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821271+0000", 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193401 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:13.347 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821965+0000", 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069420199999999999 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822036+0000", 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1119999999999997e-05 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822086+0000", 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9400999999999997e-05 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:327 3.8s0 3:1859e9b5:::smithi17529564-39:head [create,setxattr `sjUtrS\\bejkdS^PZ^UbhfeR]sl^p__anSUR_aom (1578) in=40b,setxattr Xgg (981) in=3b,setxattr jjU_`S[ao\\\\^aUS`bZo^cefhdeaegSZfc]sS[m[k (631) in=40b,setxattr WptVXs^]ZljihqWVjRTTRsYbpoOd[kede^[d^iNS (15648) in=40b,setxattr NUPa_VdcRWiTY (981) in=13b,setxattr oapqrhbaXndiek^ec[NZPnlNjeX^`^^ht`__ll[g (630) in=40b,setxattr hUokalb_dNqZaP[SZdSptRb]ZndqQTkPSdWpXlg_ (1683) in=40b,setxattr SOaUaOtoOmejUfsqfadVc_\\fpWak\\^nknRQfaXOZ (9120) in=40b,setxattr r[RO_Pl (981) in=7b,setxattr OOd^ZXYi[]NO^mlSkQafkPlVaY`UYcd\\bnaQUZjq (1225) in=40b,setxattr mlY]_qqgYNhaYetZtkgQPN^a^VmW[amS`Qbadgjr (137) in=40b,setxattr iVYdjchT[j\\[\\\\Uto`qnjUcXas^PtqZa^VoRktTT (1823) in=40b,setxattr PhV`]ZkggalnUas (981) in=15b,setxattr [TNbUtYOkT`ZatPerOQOlk\\WahmgadNWaeRZ^YT\\ (1121) in=40b,setxattr aRqq]f]b_cobaZ`ZZRaattjja[X``PaT\\l\\^Y[jU (313) in=40b,setxattr qYXjVRWg (981) in=8b,setxattr cm`nfp^lmRcSZUsStaOg_omiONqeTRWUsOjm]png (1227) in=40b,setxattr _jtbmRhQeZe]nY\\TQctPVagWm[isibp]ooW`hq[Z (1367) in=40b,setxattr _Ybhal\\]RPkmpUPPRRb[_[YfQpj[aXsgkfNbeeOZ (946) in=40b,setxattr YeQo_aSrmVSirmpTkkZqfZaaqOtg\\X\\qoRPrjPai (1786) in=40b] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.781504144000003, 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019121231999999998, 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 327 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.349 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485606+0000", 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9339999999999999e-06 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.350 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485768+0000", 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162189 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485811+0000", 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2292000000000001e-05 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485835+0000", 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4182999999999999e-05 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.351 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485963+0000", 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128157 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485976+0000", 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2571999999999999e-05 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490733+0000", 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047575610000000004 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491054+0000", 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032119599999999999 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493981+0000", 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002926484 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503531+0000", 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009550088 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.353 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503808+0000", 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027720000000000002 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.504724+0000", 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091537599999999997 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.354 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:364 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.805071656000003, 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019186933, 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 364 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.355 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462038+0000", 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6800000000000002e-06 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462048+0000", 2024-04-26T02:25:13.356 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0835999999999999e-05 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462072+0000", 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3693000000000002e-05 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462089+0000", 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6586e-05 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462283+0000", 2024-04-26T02:25:13.357 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000194496 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462306+0000", 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2476e-05 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471461+0000", 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091555809999999994 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471729+0000", 2024-04-26T02:25:13.358 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026759800000000002 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.481222+0000", 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094929869999999996 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:365 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.804985051000003, 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021296017, 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.359 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 365 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.360 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462123+0000", 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.39e-06 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462153+0000", 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9685000000000001e-05 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462165+0000", 2024-04-26T02:25:13.361 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2964e-05 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462181+0000", 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5778999999999999e-05 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462501+0000", 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031995299999999999 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462521+0000", 2024-04-26T02:25:13.362 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9715999999999999e-05 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473587+0000", 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01106558 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473802+0000", 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215899 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.483417+0000", 2024-04-26T02:25:13.363 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096150509999999995 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:366 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.80488647, 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022939240999999999, 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:13.364 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 366 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.365 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462221+0000", 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462229+0000", 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4560000000000003e-06 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462246+0000", 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7116e-05 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.366 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462259+0000", 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3526999999999999e-05 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462633+0000", 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037355199999999998 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462652+0000", 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9165999999999999e-05 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.367 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478081+0000", 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015429238 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478329+0000", 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024798499999999999 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.485159+0000", 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068299909999999997 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.368 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:508 3.8s0 3:1cc02c30:::smithi17529564-2:head [append 0~606208] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.794701901000003, 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018229054000000001, 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 508 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.369 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472408+0000", 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0800000000000002e-06 2024-04-26T02:25:13.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473853+0000", 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014451850000000001 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473888+0000", 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4891999999999997e-05 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473913+0000", 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5123e-05 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.371 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474093+0000", 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018053700000000001 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474110+0000", 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6540000000000001e-05 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479082+0000", 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049724280000000001 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.372 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479346+0000", 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026396500000000001 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.482004+0000", 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026579569999999999 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.489855+0000", 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078503649999999998 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490489+0000", 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063439499999999995 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490634+0000", 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144587 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:775 3.8s0 3:1859e9b5:::smithi17529564-39:head [copy-from ver 26] snapc 21=[21,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:13.374 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 13.619999147, 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018551978, 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 775 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.375 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647110+0000", 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6369999999999999e-06 2024-04-26T02:25:13.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647123+0000", 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648317+0000", 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193789 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648344+0000", 2024-04-26T02:25:13.377 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7373e-05 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648583+0000", 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000239299 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648858+0000", 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027470199999999999 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.660303+0000", 2024-04-26T02:25:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01144469 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.664020+0000", 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037173039999999998 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.665497+0000", 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001477351 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.379 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.665659+0000", 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016211 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:825 3.8s0 3:1cddb788:::smithi17529564-8:head [read 0~3194880,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.676919766999999, 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018450497999999999, 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:13.380 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.381 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590188+0000", 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1299999999999998e-07 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590192+0000", 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7829999999999998e-06 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590242+0000", 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9406000000000001e-05 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.382 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590251+0000", 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.38e-06 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.595683+0000", 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054322459999999999 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.595932+0000", 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024895599999999999 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.383 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.608637+0000", 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012704814 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.384 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:13.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:25:13.386 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:13.383+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:13.487 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:13.482+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:381: done (1 left) 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:382: rmattr oid 8 current snap is 40 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:382: done (1 left) 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:383: copy_from oid 35 from oid 42 current snap is 40 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 34 v 229 (ObjNum 161 snap 0 seq_num 0) dirty exists 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:380: done (1 left) 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 4 current snap is 40 2024-04-26T02:25:13.550 INFO:tasks.rados.rados.0.smithi175.stdout:384: seq_num 157 ranges {0=245760} 2024-04-26T02:25:13.555 INFO:tasks.rados.rados.0.smithi175.stdout:384: writing smithi17529564-4 from 0 to 245760 tid 1 2024-04-26T02:25:13.555 INFO:tasks.rados.rados.0.smithi175.stdout:385: delete oid 20 current snap is 40 2024-04-26T02:25:13.556 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:13.556 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:13.556 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:13.557 INFO:tasks.rados.rados.0.smithi175.stdout:383: finishing copy_from to smithi17529564-35 2024-04-26T02:25:13.557 INFO:tasks.rados.rados.0.smithi175.stdout:383: got expected ENOENT (src dne) 2024-04-26T02:25:13.557 INFO:tasks.rados.rados.0.smithi175.stdout:383: finishing copy_from racing read to smithi17529564-35 2024-04-26T02:25:13.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:25:13.581 INFO:tasks.rados.rados.0.smithi175.stdout:384: finishing write tid 1 to smithi17529564-4 2024-04-26T02:25:13.584 INFO:tasks.rados.rados.0.smithi175.stdout:384: finishing write tid 2 to smithi17529564-4 2024-04-26T02:25:13.584 INFO:tasks.rados.rados.0.smithi175.stdout:383: done (2 left) 2024-04-26T02:25:13.584 INFO:tasks.rados.rados.0.smithi175.stdout:385: done (1 left) 2024-04-26T02:25:13.584 INFO:tasks.rados.rados.0.smithi175.stdout:386: rollback oid 39 current snap is 40 2024-04-26T02:25:13.584 INFO:tasks.rados.rados.0.smithi175.stdout:rollback oid 39 to 14 2024-04-26T02:25:13.584 INFO:tasks.rados.rados.0.smithi175.stdout:387: delete oid 46 current snap is 40 2024-04-26T02:25:13.587 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:13.580+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:13.591 INFO:tasks.rados.rados.0.smithi175.stdout:384: finishing write tid 3 to smithi17529564-4 2024-04-26T02:25:13.591 INFO:tasks.rados.rados.0.smithi175.stdout:384: oid 4 updating version 0 to 85 2024-04-26T02:25:13.591 INFO:tasks.rados.rados.0.smithi175.stdout:384: oid 4 version 85 is already newer than 84 2024-04-26T02:25:13.591 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 85 (ObjNum 157 snap 40 seq_num 157) dirty exists 2024-04-26T02:25:13.591 INFO:tasks.rados.rados.0.smithi175.stdout:384: left oid 4 (ObjNum 157 snap 40 seq_num 157) 2024-04-26T02:25:13.593 INFO:tasks.rados.rados.0.smithi175.stdout:386: finishing rollback tid 0 to smithi17529564-39 2024-04-26T02:25:13.595 INFO:tasks.rados.rados.0.smithi175.stdout:386: finishing rollback tid 1 to smithi17529564-39 2024-04-26T02:25:13.595 INFO:tasks.rados.rados.0.smithi175.stdout:386: finishing rollback tid 2 to smithi17529564-39 2024-04-26T02:25:13.595 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 39 v 113 (ObjNum 38 snap 0 seq_num 38) dirty exists 2024-04-26T02:25:13.602 INFO:tasks.rados.rados.0.smithi175.stdout:384: done (2 left) 2024-04-26T02:25:13.602 INFO:tasks.rados.rados.0.smithi175.stdout:386: done (1 left) 2024-04-26T02:25:13.602 INFO:tasks.rados.rados.0.smithi175.stdout:387: done (0 left) 2024-04-26T02:25:13.602 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 13 current snap is 40 2024-04-26T02:25:13.602 INFO:tasks.rados.rados.0.smithi175.stdout:388: seq_num 160 ranges {0=294912} 2024-04-26T02:25:13.604 INFO:tasks.rados.rados.0.smithi175.stdout:388: writing smithi17529564-13 from 0 to 294912 tid 1 2024-04-26T02:25:13.604 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 36 current snap is 40 2024-04-26T02:25:13.604 INFO:tasks.rados.rados.0.smithi175.stdout:389: seq_num 161 ranges {0=311296} 2024-04-26T02:25:13.605 INFO:tasks.rados.rados.0.smithi175.stdout:389: writing smithi17529564-36 from 0 to 311296 tid 1 2024-04-26T02:25:13.606 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 9 current snap is 40 2024-04-26T02:25:13.606 INFO:tasks.rados.rados.0.smithi175.stdout:390: seq_num 162 ranges {294912=327680} 2024-04-26T02:25:13.609 INFO:tasks.rados.rados.0.smithi175.stdout:390: writing smithi17529564-9 from 294912 to 622592 tid 1 2024-04-26T02:25:13.610 INFO:tasks.rados.rados.0.smithi175.stdout:391: setattr oid 4 current snap is 40 2024-04-26T02:25:13.610 INFO:tasks.rados.rados.0.smithi175.stdout:388: finishing write tid 1 to smithi17529564-13 2024-04-26T02:25:13.611 INFO:tasks.rados.rados.0.smithi175.stdout:388: finishing write tid 2 to smithi17529564-13 2024-04-26T02:25:13.612 INFO:tasks.rados.rados.0.smithi175.stdout:392: snap_remove snap 37 2024-04-26T02:25:13.689 INFO:tasks.ceph.osd.11.smithi175.stderr:2024-04-26T02:25:13.684+0000 7f30036b2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 25330) UID: 0 2024-04-26T02:25:13.704 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:13.704 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:13.704 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:13.704 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:13.704 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:13.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:25:13.790 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:13.786+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:13.844 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:13.844 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:25:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 68.801475409999995, 2024-04-26T02:25:13.845 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082822989999999999, 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039355+0000", 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3300000000000001e-07 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039418+0000", 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2694999999999995e-05 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039447+0000", 2024-04-26T02:25:13.847 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9442e-05 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039470+0000", 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039659+0000", 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018914299999999999 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.848 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039683+0000", 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3915999999999999e-05 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047533+0000", 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078494710000000002 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047636+0000", 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103566 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.849 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 67.799299859000001, 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011160114, 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.850 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4000000000000002e-07 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041580+0000", 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9351999999999998e-05 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041619+0000", 2024-04-26T02:25:13.852 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9152000000000001e-05 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041643+0000", 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.421e-05 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041841+0000", 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197784 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.853 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041867+0000", 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5939e-05 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052596+0000", 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01072906 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052690+0000", 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4077000000000001e-05 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.854 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 50.981360887999998, 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083055990000000003, 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:13.855 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.856 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8700000000000001e-07 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862768+0000", 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003299438 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.858 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862799+0000", 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0465999999999999e-05 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862815+0000", 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6118999999999999e-05 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862957+0000", 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014188100000000001 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.859 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862972+0000", 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5512999999999999e-05 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867700+0000", 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00472735 2024-04-26T02:25:13.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867774+0000", 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4444999999999996e-05 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs2 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:25:13.861 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.279444507000001, 2024-04-26T02:25:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093447500000000006, 2024-04-26T02:25:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.862 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561386+0000", 2024-04-26T02:25:13.863 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8999999999999996e-07 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561441+0000", 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5689000000000002e-05 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561502+0000", 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0788000000000001e-05 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.864 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561527+0000", 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4479999999999999e-05 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561735+0000", 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020879899999999999 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561760+0000", 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5003000000000001e-05 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.865 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570592+0000", 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088311770000000008 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570730+0000", 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138224 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:13.866 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.274775200000001, 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013994609999999999, 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.867 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566055+0000", 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.868 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566133+0000", 2024-04-26T02:25:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7651999999999994e-05 2024-04-26T02:25:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566166+0000", 2024-04-26T02:25:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3189999999999999e-05 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566189+0000", 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3315e-05 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566604+0000", 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041534500000000002 2024-04-26T02:25:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566631+0000", 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6792999999999999e-05 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579960+0000", 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013328751 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580049+0000", 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8918000000000005e-05 2024-04-26T02:25:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.272702029999998, 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015943736999999999, 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.873 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568128+0000", 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3e-07 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568181+0000", 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2899000000000003e-05 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568212+0000", 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0596000000000003e-05 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568238+0000", 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6169999999999998e-05 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.875 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568483+0000", 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000245121 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568508+0000", 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5593e-05 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.583979+0000", 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015470133 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.876 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584071+0000", 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2595000000000004e-05 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.270057264999998, 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013783561999999999, 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.877 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.878 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570774+0000", 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6029999999999999e-06 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570834+0000", 2024-04-26T02:25:13.879 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0248999999999999e-05 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570863+0000", 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8473e-05 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570927+0000", 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4335e-05 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.880 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571242+0000", 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000315144 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571308+0000", 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5808000000000004e-05 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584459+0000", 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013150818 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.881 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584556+0000", 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7132000000000004e-05 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.266775166000002, 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011186935, 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.882 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574055+0000", 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:25:13.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574110+0000", 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4701999999999999e-05 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574134+0000", 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4672999999999999e-05 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574153+0000", 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8372999999999998e-05 2024-04-26T02:25:13.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576753+0000", 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026005830000000001 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576778+0000", 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4793000000000001e-05 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585168+0000", 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083896360000000007 2024-04-26T02:25:13.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585241+0000", 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3515000000000003e-05 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.265082808000003, 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084735320000000006, 2024-04-26T02:25:13.886 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.887 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575749+0000", 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8700000000000001e-06 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575775+0000", 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6783000000000001e-05 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.888 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575804+0000", 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8296000000000001e-05 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575826+0000", 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1970000000000001e-05 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.889 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576058+0000", 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023252799999999999 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576084+0000", 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5469e-05 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584119+0000", 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080353009999999999 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.890 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584220+0000", 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101315 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 47.261969825000001, 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010250464000000001, 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.892 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578862+0000", 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.136e-06 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578953+0000", 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1671999999999999e-05 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578986+0000", 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2431999999999997e-05 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.893 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579009+0000", 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2997e-05 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580832+0000", 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018229279999999999 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580857+0000", 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5069999999999999e-05 2024-04-26T02:25:13.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589005+0000", 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081481079999999994 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589110+0000", 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105121 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.895 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 70/31 ECSubWrite(tid=55, reqid=client.4589.0:560, at_version=70'42, trim_to=0'0, roll_forward_to=66'40))", 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.275581588999998, 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093224269999999995, 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.896 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565250+0000", 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6199999999999999e-06 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565896+0000", 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064622300000000002 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.897 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565930+0000", 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4175999999999999e-05 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565946+0000", 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6552999999999999e-05 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566110+0000", 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000163468 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.898 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566143+0000", 2024-04-26T02:25:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2833000000000002e-05 2024-04-26T02:25:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.899 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574369+0000", 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082260839999999998 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574570+0000", 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020147000000000001 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 70/31 ECSubWrite(tid=94, reqid=client.4589.0:568, at_version=70'45, trim_to=0'0, roll_forward_to=66'44))", 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 36.250862497, 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008202048, 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.901 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589975+0000", 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3129999999999999e-06 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590472+0000", 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00049691600000000002 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.902 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590505+0000", 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2285e-05 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590526+0000", 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1923999999999999e-05 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590669+0000", 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014244400000000001 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590693+0000", 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4459000000000001e-05 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598075+0000", 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073818080000000001 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598169+0000", 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3899000000000003e-05 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.904 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.362745089000001, 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082988119999999992, 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:13.905 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478086+0000", 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.734e-06 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478493+0000", 2024-04-26T02:25:13.906 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040724799999999997 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478528+0000", 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4873000000000003e-05 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478550+0000", 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2056e-05 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.907 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478704+0000", 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015417299999999999 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478732+0000", 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7063000000000002e-05 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486268+0000", 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075361270000000001 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.908 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486383+0000", 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115538 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=143, reqid=osd.13.0:143, at_version=85'52, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.352590501999998, 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011977942, 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.909 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.910 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488240+0000", 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0999999999999999e-07 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488293+0000", 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3179e-05 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488325+0000", 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2786000000000001e-05 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.911 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488348+0000", 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2572999999999999e-05 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488541+0000", 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019315599999999999 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488567+0000", 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5746e-05 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.912 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500120+0000", 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011552644000000001 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500217+0000", 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7348000000000004e-05 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.913 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s5 85/31 ECSubWrite(tid=45, reqid=osd.3.0:45, at_version=85'42, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.348864422999998, 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093409329999999992, 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.914 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491967+0000", 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492019+0000", 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2326e-05 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.915 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492059+0000", 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0499e-05 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492088+0000", 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8883000000000001e-05 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493095+0000", 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010064850000000001 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.916 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493119+0000", 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3900000000000002e-05 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501188+0000", 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080696529999999995 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501306+0000", 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011764699999999999 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.917 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 85/31 ECSubWrite(tid=259, reqid=osd.6.0:259, at_version=85'86, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.348717155999999, 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091845999999999994, 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492113+0000", 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1399999999999997e-07 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492162+0000", 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9152e-05 2024-04-26T02:25:13.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492192+0000", 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9983000000000001e-05 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492215+0000", 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3206000000000001e-05 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492386+0000", 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000170466 2024-04-26T02:25:13.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5225999999999999e-05 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501191+0000", 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087800949999999999 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501297+0000", 2024-04-26T02:25:13.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105858 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 85/31 ECSubWrite(tid=57, reqid=osd.14.0:57, at_version=85'56, trim_to=0'0, roll_forward_to=82'54))", 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.348454580999999, 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088827960000000001, 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492376+0000", 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1600000000000001e-07 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492431+0000", 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5229000000000003e-05 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492463+0000", 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2716000000000003e-05 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492487+0000", 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3050000000000001e-05 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492914+0000", 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042767800000000002 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492946+0000", 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1772e-05 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501157+0000", 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082111800000000002 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501258+0000", 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100555 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=144, reqid=osd.13.0:144, at_version=85'54, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.344681756, 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083376070000000004, 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.926 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496155+0000", 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5669999999999997e-06 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496209+0000", 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3538999999999997e-05 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496244+0000", 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4665000000000001e-05 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496267+0000", 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3533e-05 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496416+0000", 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014877400000000001 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496443+0000", 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7146000000000001e-05 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504421+0000", 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079782480000000003 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504485+0000", 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4134999999999995e-05 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 101/31 ECSubWrite(tid=223, reqid=client.4589.0:844, at_version=101'78, trim_to=0'0, roll_forward_to=95'76))", 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:08.558401+0000", 2024-04-26T02:25:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2824281790000001, 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008520339, 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.558401+0000", 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.558401+0000", 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.558402+0000", 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2300000000000001e-07 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.560975+0000", 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025732789999999999 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561004+0000", 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8317e-05 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561019+0000", 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5726000000000002e-05 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561166+0000", 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014697399999999999 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561182+0000", 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6067e-05 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.566844+0000", 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056617179999999996 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.566922+0000", 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7634999999999998e-05 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 101/31 ECSubWrite(tid=177, reqid=client.4589.0:858, at_version=101'68, trim_to=0'0, roll_forward_to=100'66))", 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:08.639837+0000", 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 5.2009927149999999, 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083802570000000003, 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.639837+0000", 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.639837+0000", 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.639838+0000", 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8899999999999998e-07 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.641956+0000", 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002118628 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:13.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.641986+0000", 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0051000000000001e-05 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.641998+0000", 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1986e-05 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642124+0000", 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012521599999999999 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642140+0000", 2024-04-26T02:25:13.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6039999999999999e-05 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.648108+0000", 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005968859 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.648217+0000", 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000108588 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:13.938 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:13.939 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:13.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:25:13.941 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:13.934+0000 7f3d71e1f640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 12 (PID: 25085) UID: 0 2024-04-26T02:25:14.041 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:25:14.039+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:25:14.063 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] out_osds: [] dead_osds: [14] live_osds: [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 3, 7, 11, 15] 2024-04-26T02:25:14.063 INFO:tasks.thrashosds.thrasher:choose_action: min_in 8 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-26T02:25:14.063 INFO:tasks.thrashosds.thrasher:test_bluestore_reshard started 2024-04-26T02:25:14.063 INFO:tasks.thrashosds.thrasher:Killing osd 12, live_osds are [0, 4, 8, 12, 1, 5, 9, 13, 2, 6, 10, 3, 7, 11, 15] 2024-04-26T02:25:14.064 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2024-04-26T02:25:14.064 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:25:14.070 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:14.071 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:14.071 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:14.071 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:14.085 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:25:14.133 INFO:tasks.ceph.osd.12:Stopped 2024-04-26T02:25:14.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 12 2024-04-26T02:25:14.181 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:14.178+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:14.204 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:14.204 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:14.204 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:14.205 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:14.205 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:14.220 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:25:14.266 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:14.260+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:14.344 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:14.343+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:14.345 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 69.306941373000001, 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011126728000000001, 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.346 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.347 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034940+0000", 2024-04-26T02:25:14.348 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.663e-06 2024-04-26T02:25:14.348 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.348 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.348 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.348 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034988+0000", 2024-04-26T02:25:14.349 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7794999999999999e-05 2024-04-26T02:25:14.349 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.349 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.349 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.351 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035017+0000", 2024-04-26T02:25:14.351 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9139e-05 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035039+0000", 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2178999999999999e-05 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035616+0000", 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057682000000000002 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.352 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035639+0000", 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2915999999999999e-05 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045974+0000", 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01033568 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046065+0000", 2024-04-26T02:25:14.353 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0536000000000002e-05 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=132, reqid=osd.12.0:132, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.775780374999997, 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012148091999999999, 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.354 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566100+0000", 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5400000000000002e-07 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566148+0000", 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8294999999999998e-05 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566223+0000", 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5108e-05 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566249+0000", 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6033e-05 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566409+0000", 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015976299999999999 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566436+0000", 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7226e-05 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578152+0000", 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011716358 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578247+0000", 2024-04-26T02:25:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4854999999999999e-05 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.774939144999998, 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010768801999999999, 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566941+0000", 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566993+0000", 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2308999999999997e-05 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567025+0000", 2024-04-26T02:25:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1934999999999998e-05 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567047+0000", 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2024000000000001e-05 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567199+0000", 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000151662 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567223+0000", 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3717e-05 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577442+0000", 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010219257000000001 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577709+0000", 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000267211 2024-04-26T02:25:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.774782690999999, 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014918226, 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567098+0000", 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.463e-06 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567147+0000", 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8551999999999999e-05 2024-04-26T02:25:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567169+0000", 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2215999999999999e-05 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567188+0000", 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8756000000000001e-05 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571613+0000", 2024-04-26T02:25:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004424936 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9245000000000001e-05 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581898+0000", 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010246251 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.369 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.582015+0000", 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011680699999999999 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.771375276000001, 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013337598000000001, 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.370 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.371 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570506+0000", 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.844e-06 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570590+0000", 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3950999999999996e-05 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570623+0000", 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3315999999999997e-05 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.372 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570651+0000", 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7319000000000001e-05 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571614+0000", 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00096303399999999998 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.373 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8068999999999998e-05 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583776+0000", 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012123818999999999 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583842+0000", 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6246000000000002e-05 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:14.375 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.769015602000003, 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011065805, 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.376 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572865+0000", 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9400000000000004e-07 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572920+0000", 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5031999999999998e-05 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.377 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572952+0000", 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1992000000000001e-05 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572974+0000", 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1829999999999999e-05 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.378 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.379 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573193+0000", 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021909100000000001 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573218+0000", 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5363000000000001e-05 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583849+0000", 2024-04-26T02:25:14.380 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010630472 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583930+0000", 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1230999999999995e-05 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 40.847622340000001, 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010850225, 2024-04-26T02:25:14.381 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.382 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494258+0000", 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1069999999999999e-06 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494289+0000", 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0175000000000002e-05 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.383 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494320+0000", 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1869999999999998e-05 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494360+0000", 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9952e-05 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496568+0000", 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022078480000000001 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496593+0000", 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4641999999999999e-05 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505054+0000", 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084610469999999993 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505107+0000", 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3584000000000001e-05 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.385 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=77, reqid=osd.11.0:77, at_version=85'63, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.862025788, 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012557278, 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:14.386 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9299999999999997e-07 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.387 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479907+0000", 2024-04-26T02:25:14.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2293999999999998e-05 2024-04-26T02:25:14.388 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.388 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.388 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.388 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479938+0000", 2024-04-26T02:25:14.388 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0728999999999997e-05 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479960+0000", 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480947+0000", 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0009871490000000001 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.389 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480973+0000", 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5704999999999999e-05 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492318+0000", 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0113448 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3225000000000003e-05 2024-04-26T02:25:14.390 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 85/31 ECSubWrite(tid=84, reqid=osd.8.0:84, at_version=85'61, trim_to=0'0, roll_forward_to=83'59))", 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.858452534000001, 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011418342, 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.392 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.393 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483428+0000", 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483486+0000", 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8236999999999998e-05 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.394 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483515+0000", 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9169000000000001e-05 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483539+0000", 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4226000000000001e-05 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.395 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484639+0000", 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001099952 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484657+0000", 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7496999999999999e-05 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494743+0000", 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010086573 2024-04-26T02:25:14.396 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494845+0000", 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102042 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.857362970000001, 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010793934, 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.397 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.398 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484518+0000", 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.22e-06 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484568+0000", 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9798e-05 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484599+0000", 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1384999999999999e-05 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.399 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484621+0000", 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1818999999999999e-05 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492500+0000", 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007879268 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492527+0000", 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7212e-05 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.400 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495235+0000", 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027078060000000001 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495311+0000", 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5426000000000006e-05 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.401 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 90/31 ECSubWrite(tid=288, reqid=client.4589.0:736, at_version=90'154, trim_to=0'0, roll_forward_to=88'152))", 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 16.854586584, 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012431226, 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.402 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487294+0000", 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7700000000000004e-07 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.403 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487571+0000", 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027720199999999999 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487600+0000", 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9028999999999999e-05 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487617+0000", 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6878999999999999e-05 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.404 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487802+0000", 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018537999999999999 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487856+0000", 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4237000000000003e-05 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.406 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499640+0000", 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011783903 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499724+0000", 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4018999999999996e-05 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:849 3.7s0 3:ed555be7:::smithi17529564-3:head [create,setxattr clNOgfqtsg\\aUXcbnbsgicte[dlcgscTctZg\\UYb (1261) in=40b,setxattr ^kePZO^jc[`nRrZQr^g`hWUbUbmVa_[^`ndQ_ebi (207) in=40b,setxattr pd\\tReSgkdQqSk_oQZgRskailqSfXkleakRgOpgs (735) in=40b,setxattr `\\Uhenhpc\\oVlscgQb^Wpj]b[jPkrs]S`tY^nfNX (1506) in=40b,setxattr mYhN^Rig]VasbVqh]mfR[[pqUcOYh]_aWp\\m_tls (1891) in=40b,setxattr hie`]lstsZtOilXYaRecaiXtt]gcmm^a[tWjt[YT (311) in=40b,setxattr hkRZhYOPaigVYZmnZe^p`NTbkSNSiVgfgVijksca (455) in=40b,setxattr `sdWbhfe[ng_eOr]YcXa]ahtbPgochac``jdt`hh (1262) in=40b,setxattr aPlreWi_Xm]iktYWh`g_aSaRPrXe]adtOdO]]bsq (347) in=40b,setxattr p_qb[TbOoSb^Z[jcnVcp[Vb_XQ^gddoWiVa^NPYR (385) in=40b,setxattr VgQd`_b]^jekaYilkQoqdami]]mhVp\\fbWfmkbVU (1295) in=40b,setxattr tWfY]UYjtVla^t`]`Z[s\\sp`]jp^jcoVP[kaYTjb (1893) in=40b,setxattr ZeWXgW`YOnsgbbrr`eRYbpbOQeTm_g^hkeqUdl_X (982) in=40b,setxattr aoh__jnjZmcV_Zd[lTjob_PfRoWV (1822) in=28b,setxattr Og\\PgsWdl_jTZ]kbbRXdO`bhQsdfmNUjgURgh\\`^ (1997) in=40b,setxattr fWcmbPRf_fT[s`o`jq^\\U_m_UlTQhjpPfe]Oq^Zs (1645) in=40b,setxattr jQT^\\Zie\\orcqPOr]sg\\\\PWNdY`OYs^QYktWQsTd (1789) in=40b,setxattr N_TeWQ`\\cU]`mQPYod^P]RXe[YaVQncV^sk`_bVn (1785) in=40b,setxattr jQhOSafV (1822) in=8b,setxattr ]daaodicjtV`q_`__etNiom_n`abiaa`sbrXmcaT (947) in=40b] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:14.407 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.561881+0000", 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7799985400000002, 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012640907, 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 849 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.408 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561881+0000", 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561881+0000", 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561885+0000", 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7500000000000001e-06 2024-04-26T02:25:14.409 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561955+0000", 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9898000000000001e-05 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.410 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561993+0000", 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7895999999999998e-05 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.562016+0000", 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3379000000000001e-05 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.564350+0000", 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023341999999999998 2024-04-26T02:25:14.411 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.564802+0000", 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000452146 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.567916+0000", 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031137389999999999 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.572994+0000", 2024-04-26T02:25:14.412 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050781899999999998 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.573245+0000", 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025114400000000002 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.574522+0000", 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0012765649999999999 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.413 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:861 3.7s0 3:e9c97fb0:::smithi17529564-43:26 [read 0~2949120,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.622793+0000", 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7190866629999997, 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016005122, 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 861 2024-04-26T02:25:14.414 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622793+0000", 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622793+0000", 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.415 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622796+0000", 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.23e-06 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622812+0000", 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5787e-05 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622853+0000", 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1211999999999998e-05 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.416 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622876+0000", 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2901999999999999e-05 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623018+0000", 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014194000000000001 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623509+0000", 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049130799999999998 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.417 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638798+0000", 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015288743 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:862 3.7s0 3:e9c97fb0:::smithi17529564-43:26 [read 0~2949120,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.622925+0000", 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7189547430000003, 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021613954000000001, 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.418 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 862 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622925+0000", 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.419 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622925+0000", 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622926+0000", 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5629999999999999e-06 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622938+0000", 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1240000000000001e-05 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622958+0000", 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0426000000000001e-05 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622982+0000", 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3516e-05 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.625947+0000", 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029656880000000002 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.421 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626282+0000", 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033498700000000002 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.644539+0000", 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018256534000000001 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:863 3.7s0 3:e9c97fb0:::smithi17529564-43:26 [read 0~2949120,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.623013+0000", 2024-04-26T02:25:14.422 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7188664359999999, 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.026093545999999999, 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 863 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623013+0000", 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.423 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623013+0000", 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623014+0000", 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.217e-06 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623022+0000", 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8429999999999993e-06 2024-04-26T02:25:14.424 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623041+0000", 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8573e-05 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623054+0000", 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3269e-05 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.629657+0000", 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066030500000000001 2024-04-26T02:25:14.425 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.629784+0000", 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012652400000000001 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.649107+0000", 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019323070000000001 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.426 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 101/31 ECSubWrite(tid=225, reqid=client.4589.0:864, at_version=101'112, trim_to=0'0, roll_forward_to=100'110))", 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.626538+0000", 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7153415870000002, 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012379775000000001, 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626538+0000", 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.427 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626538+0000", 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626539+0000", 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4600000000000004e-07 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626596+0000", 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7404999999999997e-05 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.428 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626619+0000", 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3286e-05 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626640+0000", 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0333e-05 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626743+0000", 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103646 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.429 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626755+0000", 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1712999999999999e-05 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638845+0000", 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012089501000000001 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638918+0000", 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3145000000000005e-05 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.430 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 101/31 ECSubWrite(tid=362, reqid=client.4589.0:867, at_version=101'209, trim_to=0'0, roll_forward_to=101'207))", 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.630898+0000", 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7109819709999998, 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017385771000000001, 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.630898+0000", 2024-04-26T02:25:14.431 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.630898+0000", 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.630899+0000", 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3239999999999999e-06 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631118+0000", 2024-04-26T02:25:14.432 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021913 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631148+0000", 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9856e-05 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631171+0000", 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2901999999999999e-05 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631370+0000", 2024-04-26T02:25:14.433 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019881400000000001 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631394+0000", 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4465999999999999e-05 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.648175+0000", 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016781292 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.648283+0000", 2024-04-26T02:25:14.434 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010798699999999999 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.7s0 101/95 ECSubReadReply(tid=54, attrs_read=0))", 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.637871+0000", 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7040080880000001, 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011349812000000001, 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.435 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637871+0000", 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637871+0000", 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637873+0000", 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.184e-06 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.436 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.640161+0000", 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022883320000000001 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.640190+0000", 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8619000000000002e-05 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.640208+0000", 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8229000000000001e-05 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.437 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.645328+0000", 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051196920000000003 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.649221+0000", 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003893756 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.438 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 101/31 ECSubWrite(tid=363, reqid=client.4589.0:856, at_version=101'211, trim_to=0'0, roll_forward_to=101'207))", 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.639048+0000", 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.7028318909999998, 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012281583, 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.639048+0000", 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.439 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.639048+0000", 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.639049+0000", 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.708e-06 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642102+0000", 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0030523579999999998 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.440 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642261+0000", 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000159233 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642285+0000", 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3767000000000001e-05 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642601+0000", 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031657700000000002 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.441 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642630+0000", 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8572999999999999e-05 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.651227+0000", 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085968069999999997 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.651329+0000", 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010255999999999999 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.442 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:900 3.7s0 3:e9c97fb0:::smithi17529564-43:head [delete] snapc 29=[29,28,27,26,23,22,21,19,10] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105)", 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:12.588200+0000", 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 1.7536795170000001, 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011191424, 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 900 2024-04-26T02:25:14.443 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588200+0000", 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588200+0000", 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588202+0000", 2024-04-26T02:25:14.444 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1320000000000001e-06 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588210+0000", 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7559999999999999e-06 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588229+0000", 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9327e-05 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588266+0000", 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6275000000000001e-05 2024-04-26T02:25:14.445 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588399+0000", 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013349600000000001 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588625+0000", 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022554500000000001 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.590084+0000", 2024-04-26T02:25:14.446 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014594930000000001 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.594944+0000", 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048599130000000004 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.598749+0000", 2024-04-26T02:25:14.447 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003804998 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.599391+0000", 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064248899999999999 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:14.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:25:14.450 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:14.446+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:14.458 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-26T02:25:14.454+0000 7f2c4020a640 -1 mon.a@0(leader).osd e106 definitely_dead 0 2024-04-26T02:25:14.502 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:25:14.551 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:14.544+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:14.553 INFO:teuthology.orchestra.run.smithi059.stderr:marked down osd.12. 2024-04-26T02:25:14.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T02:25:14.559 INFO:tasks.rados.rados.0.smithi175.stdout:392: done (4 left) 2024-04-26T02:25:14.559 INFO:tasks.rados.rados.0.smithi175.stdout:393: snap_create 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:390: finishing write tid 1 to smithi17529564-9 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:388: finishing write tid 3 to smithi17529564-13 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:388: oid 13 updating version 0 to 243 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:388: oid 13 version 243 is already newer than 242 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 13 v 243 (ObjNum 160 snap 40 seq_num 160) dirty exists 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:388: left oid 13 (ObjNum 160 snap 40 seq_num 160) 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:389: finishing write tid 1 to smithi17529564-36 2024-04-26T02:25:14.560 INFO:tasks.rados.rados.0.smithi175.stdout:390: finishing write tid 2 to smithi17529564-9 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:389: finishing write tid 2 to smithi17529564-36 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 86 (ObjNum 157 snap 40 seq_num 157) dirty exists 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:390: finishing write tid 3 to smithi17529564-9 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:390: oid 9 updating version 0 to 74 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:390: oid 9 updating version 74 to 75 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 9 v 75 (ObjNum 162 snap 40 seq_num 162) dirty exists 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:390: left oid 9 (ObjNum 162 snap 40 seq_num 162) 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:389: finishing write tid 3 to smithi17529564-36 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:389: oid 36 updating version 0 to 57 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:389: oid 36 updating version 57 to 58 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 36 v 58 (ObjNum 161 snap 40 seq_num 161) dirty exists 2024-04-26T02:25:14.561 INFO:tasks.rados.rados.0.smithi175.stdout:389: left oid 36 (ObjNum 161 snap 40 seq_num 161) 2024-04-26T02:25:14.585 INFO:tasks.thrashosds.thrasher:Removing osd 12, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15] 2024-04-26T02:25:14.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 12 2024-04-26T02:25:14.623 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:14.623 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:14.623 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:14.637 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:25:14.652 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:14.651+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:14.711 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:25:14.711 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:25:14.732 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:25:14.732 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:25:14.753 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:25:14.753 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:25:14.754 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:14.751+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:14.787 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:25:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:25:14.807 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:14.807 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:14.807 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:14.807 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:14.807 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:14.821 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:25:14.854 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:14.851+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:14.927 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-26T02:25:14.922+0000 7f2c4020a640 -1 mon.a@0(leader).osd e107 definitely_dead 0 2024-04-26T02:25:14.945 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:14.945 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:14.945 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:276 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.782977607000007, 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015591825, 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.946 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 276 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.947 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158464+0000", 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4240000000000003e-06 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158778+0000", 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031355400000000001 2024-04-26T02:25:14.948 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158793+0000", 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5654e-05 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158804+0000", 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0543000000000001e-05 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.949 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158964+0000", 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015994199999999999 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.159116+0000", 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152194 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161895+0000", 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027785510000000002 2024-04-26T02:25:14.950 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173835+0000", 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011940014000000001 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173974+0000", 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000139546 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.951 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174052+0000", 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7403000000000004e-05 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:280 3.1s0 3:8c97d9d7:::smithi17529564-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 64.775919578, 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018442278999999999, 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.952 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 280 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:14.953 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165519+0000", 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165523+0000", 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9400000000000004e-06 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.954 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165535+0000", 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2486e-05 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165546+0000", 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175360+0000", 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098140950000000001 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.955 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175447+0000", 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7737000000000004e-05 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179821+0000", 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043734860000000002 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179966+0000", 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014539199999999999 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.956 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183960+0000", 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039937430000000001 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:422 3.1s0 3:80641982:::smithi17529564-25:head [copy-from ver 55] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.109699606, 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.038918576000000003, 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.957 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 422 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.958 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831740+0000", 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5440000000000001e-06 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.959 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831752+0000", 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2041999999999999e-05 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831781+0000", 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8833999999999999e-05 2024-04-26T02:25:14.960 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831794+0000", 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3349e-05 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831860+0000", 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5356000000000002e-05 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.961 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831926+0000", 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6396000000000006e-05 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.859553+0000", 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027626301999999998 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866678+0000", 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007125803 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.962 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870520+0000", 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003841952 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870656+0000", 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013599799999999999 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:423 3.1s0 3:80641982:::smithi17529564-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:14.963 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 52.109615765000001, 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.034213080999999999, 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 423 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.964 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.965 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831827+0000", 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.792e-06 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831839+0000", 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1712000000000001e-05 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831846+0000", 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9199999999999998e-06 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.966 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832063+0000", 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021765599999999999 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832133+0000", 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9449999999999994e-05 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.967 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865896+0000", 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.033763107000000001 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865962+0000", 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5810999999999997e-05 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866035+0000", 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2782999999999998e-05 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.968 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:503 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.378730083000001, 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019134271000000001, 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 503 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.969 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.970 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562709+0000", 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1500000000000002e-06 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562720+0000", 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0746e-05 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562740+0000", 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0370999999999999e-05 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.971 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562753+0000", 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2561999999999999e-05 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562867+0000", 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113841 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562881+0000", 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3709999999999999e-05 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.972 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569080+0000", 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061992339999999996 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569415+0000", 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033499799999999998 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581842+0000", 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012426659 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.973 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:504 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.378657689000001, 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020273925000000002, 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.974 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 504 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.975 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562781+0000", 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562797+0000", 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6254000000000001e-05 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562809+0000", 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2204e-05 2024-04-26T02:25:14.976 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562818+0000", 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8459999999999997e-06 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562987+0000", 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016880399999999999 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562997+0000", 2024-04-26T02:25:14.977 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0713000000000001e-05 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570438+0000", 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007440894 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570691+0000", 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025249400000000003 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.978 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583054+0000", 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012362720000000001 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:505 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.378603511999998, 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.032520136999999998, 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.979 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 505 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.980 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562835+0000", 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0200000000000001e-07 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562839+0000", 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5839999999999996e-06 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.981 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562853+0000", 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4216000000000001e-05 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562864+0000", 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0579e-05 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563046+0000", 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018216799999999999 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.982 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563058+0000", 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1378e-05 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571720+0000", 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086620359999999997 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571999+0000", 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027927099999999999 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595354+0000", 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023355102999999999 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=45, attrs_read=0))", 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.361164342000002, 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015110926, 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.984 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.985 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584305+0000", 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040320649999999996 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.986 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584322+0000", 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7076e-05 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594641+0000", 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010319246000000001 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595384+0000", 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074253899999999996 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.987 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:560 3.1s0 3:80641982:::smithi17529564-25:head [append 0~770048] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.379516838000001, 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018860572999999999, 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 560 2024-04-26T02:25:14.988 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.989 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561923+0000", 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9890000000000001e-06 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562755+0000", 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083166800000000003 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562788+0000", 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2960000000000003e-05 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.990 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562804+0000", 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5636000000000001e-05 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562942+0000", 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000138271 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.991 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.563116+0000", 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017447599999999999 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.565388+0000", 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002271295 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.992 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574120+0000", 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087317829999999999 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580556+0000", 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006436509 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:14.993 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580781+0000", 2024-04-26T02:25:14.994 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022498599999999999 2024-04-26T02:25:14.994 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.994 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:14.994 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:14.995 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.995 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:564 3.1s0 3:80641982:::smithi17529564-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:14.995 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:14.995 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 37.36730429, 2024-04-26T02:25:14.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021517379, 2024-04-26T02:25:14.995 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 564 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574135+0000", 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.689e-06 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574143+0000", 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9270000000000005e-06 2024-04-26T02:25:14.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574163+0000", 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0392999999999999e-05 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574183+0000", 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0210000000000001e-05 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581120+0000", 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069366829999999999 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581385+0000", 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026519800000000002 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587167+0000", 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057815389999999996 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:14.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587435+0000", 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026854500000000003 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.595650+0000", 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082151949999999998 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:766 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.327069062, 2024-04-26T02:25:15.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.031525108000000003, 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 766 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614371+0000", 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9469999999999999e-06 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614402+0000", 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1068999999999997e-05 2024-04-26T02:25:15.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614436+0000", 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4032000000000002e-05 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614464+0000", 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7484999999999999e-05 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614582+0000", 2024-04-26T02:25:15.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118195 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614596+0000", 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4127999999999999e-05 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.618371+0000", 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037749810000000002 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.618590+0000", 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021933799999999999 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645893+0000", 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027302933000000001 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:767 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:15.005 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.326938833, 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.035408467999999998, 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 767 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:15.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614499+0000", 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4e-07 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614505+0000", 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.49e-06 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614520+0000", 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5119e-05 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614528+0000", 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4230000000000005e-06 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614744+0000", 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000215942 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614759+0000", 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5075999999999999e-05 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.621172+0000", 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064126909999999999 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.621439+0000", 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026644700000000001 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.649907+0000", 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028468340000000002 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.010 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:768 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.326864972999999, 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.039201346999999998, 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 768 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614573+0000", 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614578+0000", 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.933e-06 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614589+0000", 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1374e-05 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.013 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614598+0000", 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2619999999999998e-06 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614806+0000", 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020866 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614817+0000", 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0992000000000001e-05 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627773+0000", 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012955250999999999 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.628082+0000", 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000309525 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.653774+0000", 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02569159 2024-04-26T02:25:15.015 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 91/31 ECSubReadReply(tid=80, attrs_read=0))", 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.312306555999999, 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016880775000000001, 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629132+0000", 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0999999999999997e-07 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630582+0000", 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001450231 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630599+0000", 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7272999999999999e-05 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630616+0000", 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7031e-05 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631422+0000", 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00080626000000000005 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646012+0000", 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01458917 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.311905045, 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020566872999999999, 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629534+0000", 2024-04-26T02:25:15.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6559999999999999e-06 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632692+0000", 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031580739999999999 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632723+0000", 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0953e-05 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632742+0000", 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8702000000000002e-05 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650038+0000", 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017296138999999999 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650099+0000", 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1348999999999998e-05 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.023 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 91/31 ECSubReadReply(tid=81, attrs_read=0))", 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.310796962, 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019366189999999998, 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630641+0000", 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1200000000000002e-07 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631991+0000", 2024-04-26T02:25:15.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001349615 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632006+0000", 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5162e-05 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632049+0000", 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.286e-05 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.026 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646232+0000", 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014183039 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650007+0000", 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037748019999999998 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:15.027 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.309367205999999, 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021746782999999999, 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632071+0000", 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9999999999999997e-07 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633377+0000", 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013061100000000001 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633394+0000", 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7255999999999999e-05 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633438+0000", 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4150000000000003e-05 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650410+0000", 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016971442999999999 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.653817+0000", 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034072239999999999 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 15.307882892, 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016622347999999999, 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.031 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633555+0000", 2024-04-26T02:25:15.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2399999999999996e-07 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635079+0000", 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001523216 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635097+0000", 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8488999999999999e-05 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635142+0000", 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.507e-05 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650125+0000", 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014982733 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650177+0000", 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1916000000000002e-05 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.034 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:875 3.1s0 3:8c97d9d7:::smithi17529564-6:head [delete] snapc 27=[27,26,24,23,22,21,19,10] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102)", 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:09.575270+0000", 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 5.3661669219999997, 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015600602, 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:15.035 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 875 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575270+0000", 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575270+0000", 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.036 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575274+0000", 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4740000000000001e-06 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575290+0000", 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6517000000000001e-05 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575326+0000", 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5185000000000003e-05 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.037 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575344+0000", 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8270999999999998e-05 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575541+0000", 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019670500000000001 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575568+0000", 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7402999999999998e-05 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.581789+0000", 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062212980000000001 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.582109+0000", 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000319258 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.584427+0000", 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023188729999999999 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.587421+0000", 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029932399999999999 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.590433+0000", 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0030126839999999998 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.590871+0000", 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00043769399999999997 2024-04-26T02:25:15.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:899 3.1s0 3:84b104fd:::smithi17529564-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e105)", 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:12.588480+0000", 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 2.3529571790000001, 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01760811, 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:15.041 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 899 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588480+0000", 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588480+0000", 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588481+0000", 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3489999999999999e-06 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588487+0000", 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3109999999999996e-06 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588504+0000", 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7031e-05 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588517+0000", 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3168e-05 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588594+0000", 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6582999999999995e-05 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588603+0000", 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2960000000000004e-06 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.595466+0000", 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068628739999999997 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.595535+0000", 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9665000000000005e-05 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.602493+0000", 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069576359999999997 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.602609+0000", 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011613299999999999 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.606088+0000", 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003479064 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:15.046 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:15.048 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:25:15.048 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:25:15.049 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:25:15.049 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:25:15.049 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:25:15.050 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:25:15.047+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:25:15.065 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:25:15.066 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:25:15.093 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:25:15.093 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:25:15.121 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:25:15.121 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:25:15.149 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:15.144+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:15.151 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:25:15.151 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:25:15.176 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:15.176 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:15.177 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:15.180 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:25:15.181 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:25:15.191 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:25:15.206 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:25:15.207 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:25:15.207 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.12 2024-04-26T02:25:15.236 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:25:15.237 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:25:15.237 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.14 2024-04-26T02:25:15.250 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:15.247+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:15.264 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:25:15.265 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:25:15.269 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T02:25:15.270 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T02:25:15.351 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:15.344+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:15.352 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:15.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:25:15.453 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:15.448+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:15.529 INFO:teuthology.orchestra.run.smithi175.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:15.529 INFO:teuthology.orchestra.run.smithi175.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:15.543 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T02:25:15.562 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:25:15.562 INFO:teuthology.orchestra.run.smithi059.stderr:marked out osd.12. 2024-04-26T02:25:15.563 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:15.558+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:15.578 INFO:tasks.rados.rados.0.smithi175.stdout:388: done (4 left) 2024-04-26T02:25:15.578 INFO:tasks.rados.rados.0.smithi175.stdout:389: done (3 left) 2024-04-26T02:25:15.578 INFO:tasks.rados.rados.0.smithi175.stdout:390: done (2 left) 2024-04-26T02:25:15.578 INFO:tasks.rados.rados.0.smithi175.stdout:391: done (1 left) 2024-04-26T02:25:15.578 INFO:tasks.rados.rados.0.smithi175.stdout:393: done (0 left) 2024-04-26T02:25:15.578 INFO:tasks.rados.rados.0.smithi175.stdout:append oid 4 current snap is 41 2024-04-26T02:25:15.578 INFO:tasks.rados.rados.0.smithi175.stdout:394: seq_num 163 ranges {245760=344064} 2024-04-26T02:25:15.581 INFO:tasks.rados.rados.0.smithi175.stdout:394: writing smithi17529564-4 from 245760 to 589824 tid 1 2024-04-26T02:25:15.581 INFO:tasks.rados.rados.0.smithi175.stdout:395: snap_remove snap 39 2024-04-26T02:25:15.593 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.12 2024-04-26T02:25:15.593 INFO:tasks.thrashosds.thrasher:remote for osd 12 is ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:25:15.593 INFO:tasks.thrashosds.thrasher:remote for exp osd 14 is ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:25:15.594 DEBUG:teuthology.orchestra.run.smithi142:> type ceph-objectstore-tool 2024-04-26T02:25:15.599 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-26T02:25:15.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-14 --journal-path /var/lib/ceph/osd/ceph-14/journal --op list-pgs 2024-04-26T02:25:15.653 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:15.648+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:15.681 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:15.681 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:15.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T02:25:15.754 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:15.751+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:15.817 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:15.817 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:15.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T02:25:15.855 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:15.855+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:15.957 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:15.956+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:15.957 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:15.957 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:15.972 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-26T02:25:16.057 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:16.054+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:16.099 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:16.100 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:16.114 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-26T02:25:16.158 INFO:tasks.ceph.osd.9.smithi136.stderr:2024-04-26T02:25:16.155+0000 7f4a030cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 25082) UID: 0 2024-04-26T02:25:16.260 INFO:tasks.ceph.osd.15.smithi175.stderr:2024-04-26T02:25:16.252+0000 7fe07a486640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 15 (PID: 25328) UID: 0 2024-04-26T02:25:16.286 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:16.286 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:16.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-26T02:25:16.360 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:16.359+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:16.430 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:16.431 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:16.445 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_ops_in_flight 2024-04-26T02:25:16.462 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:16.459+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:16.563 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:16.558+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:16.572 INFO:tasks.rados.rados.0.smithi175.stdout:395: done (1 left) 2024-04-26T02:25:16.572 INFO:tasks.rados.rados.0.smithi175.stdout:396: read oid 49 snap 38 2024-04-26T02:25:16.572 INFO:tasks.rados.rados.0.smithi175.stdout:396: expect (ObjNum 131 snap 27 seq_num 131) 2024-04-26T02:25:16.572 INFO:tasks.rados.rados.0.smithi175.stdout:397: read oid 8 snap 31 2024-04-26T02:25:16.572 INFO:tasks.rados.rados.0.smithi175.stdout:397: expect (ObjNum 130 snap 27 seq_num 130) 2024-04-26T02:25:16.572 INFO:tasks.rados.rados.0.smithi175.stdout:398: rmattr oid 29 current snap is 41 2024-04-26T02:25:16.572 INFO:tasks.rados.rados.0.smithi175.stdout:399: rmattr oid 6 current snap is 41 2024-04-26T02:25:16.573 INFO:tasks.rados.rados.0.smithi175.stdout:399: done (4 left) 2024-04-26T02:25:16.573 INFO:tasks.rados.rados.0.smithi175.stdout: waiting on 4 2024-04-26T02:25:16.583 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:16.584 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:16.601 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_blocked_ops 2024-04-26T02:25:16.608 INFO:tasks.rados.rados.0.smithi175.stdout:396: expect (ObjNum 131 snap 27 seq_num 131) 2024-04-26T02:25:16.663 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:16.663+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:16.765 INFO:tasks.ceph.osd.10.smithi142.stderr:2024-04-26T02:25:16.758+0000 7f734b394640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 25083) UID: 0 2024-04-26T02:25:16.765 INFO:tasks.rados.rados.0.smithi175.stdout:397: expect (ObjNum 130 snap 27 seq_num 130) 2024-04-26T02:25:16.777 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:16.777 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:16.794 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.8.asok dump_historic_ops 2024-04-26T02:25:16.796 INFO:teuthology.orchestra.run.smithi142.stdout:3.fs3 2024-04-26T02:25:16.796 INFO:teuthology.orchestra.run.smithi142.stdout:3.bs6 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:3.7s4 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:3.es1 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:3.6s1 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:3.1s2 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:3.0s5 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:3.2s0 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:2.3 2024-04-26T02:25:16.797 INFO:teuthology.orchestra.run.smithi142.stdout:2.1 2024-04-26T02:25:16.866 INFO:tasks.rados.rados.0.smithi175.stdout:394: finishing write tid 1 to smithi17529564-4 2024-04-26T02:25:16.866 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 29 v 90 (ObjNum 161 snap 0 seq_num 1) dirty exists 2024-04-26T02:25:16.866 INFO:tasks.rados.rados.0.smithi175.stdout:394: finishing write tid 2 to smithi17529564-4 2024-04-26T02:25:16.867 INFO:tasks.rados.rados.0.smithi175.stdout:394: finishing write tid 3 to smithi17529564-4 2024-04-26T02:25:16.867 INFO:tasks.rados.rados.0.smithi175.stdout:394: oid 4 updating version 0 to 88 2024-04-26T02:25:16.867 INFO:tasks.rados.rados.0.smithi175.stdout:394: oid 4 updating version 88 to 91 2024-04-26T02:25:16.867 INFO:tasks.rados.rados.0.smithi175.stdout:update_object_version oid 4 v 91 (ObjNum 163 snap 41 seq_num 163) dirty exists 2024-04-26T02:25:16.867 INFO:tasks.rados.rados.0.smithi175.stdout:394: left oid 4 (ObjNum 163 snap 41 seq_num 163) 2024-04-26T02:25:16.867 INFO:tasks.rados.rados.0.smithi175.stdout:394: done (3 left) 2024-04-26T02:25:16.868 INFO:tasks.rados.rados.0.smithi175.stdout:396: done (2 left) 2024-04-26T02:25:16.868 INFO:tasks.rados.rados.0.smithi175.stdout:397: done (1 left) 2024-04-26T02:25:16.868 INFO:tasks.rados.rados.0.smithi175.stdout:398: done (0 left) 2024-04-26T02:25:16.868 INFO:tasks.ceph.osd.4.smithi059.stderr:2024-04-26T02:25:16.862+0000 7f1f58e4e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25081) UID: 0 2024-04-26T02:25:16.875 INFO:tasks.rados.rados.0.smithi175.stderr:0 errors. 2024-04-26T02:25:16.875 INFO:tasks.rados.rados.0.smithi175.stderr: 2024-04-26T02:25:16.881 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T02:25:16.921 INFO:teuthology.orchestra.run.smithi059.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:16.922 INFO:teuthology.orchestra.run.smithi059.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:16.937 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T02:25:16.967 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:16.960+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:17.068 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:17.064+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:17.069 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:17.069 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:17.083 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T02:25:17.169 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:17.166+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:17.177 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:25:17.178 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":109,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:25:16.561355+0000","last_up_change":"2024-04-26T02:25:14.543493+0000","last_in_change":"2024-04-26T02:25:15.552890+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T02:23:46.791952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T02:23:48.950495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.0399999618530273,"score_stable":6.0399999618530273,"optimal_score":0.56000000238418579,"raw_score_acting":3.380000114440918,"raw_score_stable":3.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2024-04-26T02:23:58.002178+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":7,"min_size":5,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":42,"snap_epoch":109,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"shecprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":16384,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6803","nonce":2847130092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6805","nonce":2847130092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6809","nonce":2847130092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6807","nonce":2847130092}]},"public_addr":"172.21.15.59:6803/2847130092","cluster_addr":"172.21.15.59:6805/2847130092","heartbeat_back_addr":"172.21.15.59:6809/2847130092","heartbeat_front_addr":"172.21.15.59:6807/2847130092","state":["exists","up"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6813","nonce":504096392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6821","nonce":504096392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6829","nonce":504096392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6826","nonce":504096392}]},"public_addr":"172.21.15.136:6813/504096392","cluster_addr":"172.21.15.136:6821/504096392","heartbeat_back_addr":"172.21.15.136:6829/504096392","heartbeat_front_addr":"172.21.15.136:6826/504096392","state":["exists","up"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6801","nonce":785558131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6803","nonce":785558131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6807","nonce":785558131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6805","nonce":785558131}]},"public_addr":"172.21.15.142:6801/785558131","cluster_addr":"172.21.15.142:6803/785558131","heartbeat_back_addr":"172.21.15.142:6807/785558131","heartbeat_front_addr":"172.21.15.142:6805/785558131","state":["exists","up"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6801","nonce":3691596427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6803","nonce":3691596427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6807","nonce":3691596427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6805","nonce":3691596427}]},"public_addr":"172.21.15.175:6801/3691596427","cluster_addr":"172.21.15.175:6803/3691596427","heartbeat_back_addr":"172.21.15.175:6807/3691596427","heartbeat_front_addr":"172.21.15.175:6805/3691596427","state":["exists","up"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6821","nonce":2291404497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6823","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6825","nonce":2291404497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6831","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6833","nonce":2291404497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6827","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6829","nonce":2291404497}]},"public_addr":"172.21.15.59:6821/2291404497","cluster_addr":"172.21.15.59:6825/2291404497","heartbeat_back_addr":"172.21.15.59:6833/2291404497","heartbeat_front_addr":"172.21.15.59:6829/2291404497","state":["exists","up"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6815","nonce":3420144978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6823","nonce":3420144978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6831","nonce":3420144978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6827","nonce":3420144978}]},"public_addr":"172.21.15.136:6815/3420144978","cluster_addr":"172.21.15.136:6823/3420144978","heartbeat_back_addr":"172.21.15.136:6831/3420144978","heartbeat_front_addr":"172.21.15.136:6827/3420144978","state":["exists","up"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6825","nonce":2443484296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6827","nonce":2443484296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6831","nonce":2443484296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6829","nonce":2443484296}]},"public_addr":"172.21.15.142:6825/2443484296","cluster_addr":"172.21.15.142:6827/2443484296","heartbeat_back_addr":"172.21.15.142:6831/2443484296","heartbeat_front_addr":"172.21.15.142:6829/2443484296","state":["exists","up"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6809","nonce":1727563740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6811","nonce":1727563740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6815","nonce":1727563740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6813","nonce":1727563740}]},"public_addr":"172.21.15.175:6809/1727563740","cluster_addr":"172.21.15.175:6811/1727563740","heartbeat_back_addr":"172.21.15.175:6815/1727563740","heartbeat_front_addr":"172.21.15.175:6813/1727563740","state":["exists","up"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6820","nonce":652278083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6824","nonce":652278083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6832","nonce":652278083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6828","nonce":652278083}]},"public_addr":"172.21.15.59:6820/652278083","cluster_addr":"172.21.15.59:6824/652278083","heartbeat_back_addr":"172.21.15.59:6832/652278083","heartbeat_front_addr":"172.21.15.59:6828/652278083","state":["exists","up"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6802","nonce":1522341187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6806","nonce":1522341187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6820","nonce":1522341187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6812","nonce":1522341187}]},"public_addr":"172.21.15.136:6802/1522341187","cluster_addr":"172.21.15.136:6806/1522341187","heartbeat_back_addr":"172.21.15.136:6820/1522341187","heartbeat_front_addr":"172.21.15.136:6812/1522341187","state":["exists","up"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6810","nonce":2358058219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6813","nonce":2358058219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6819","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6820","nonce":2358058219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6815","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6817","nonce":2358058219}]},"public_addr":"172.21.15.142:6810/2358058219","cluster_addr":"172.21.15.142:6813/2358058219","heartbeat_back_addr":"172.21.15.142:6820/2358058219","heartbeat_front_addr":"172.21.15.142:6817/2358058219","state":["exists","up"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6825","nonce":3853198939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6827","nonce":3853198939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6831","nonce":3853198939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6829","nonce":3853198939}]},"public_addr":"172.21.15.175:6825/3853198939","cluster_addr":"172.21.15.175:6827/3853198939","heartbeat_back_addr":"172.21.15.175:6831/3853198939","heartbeat_front_addr":"172.21.15.175:6829/3853198939","state":["exists","up"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":107,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6811","nonce":753845278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6813","nonce":753845278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6817","nonce":753845278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":753845278},{"type":"v1","addr":"172.21.15.59:6815","nonce":753845278}]},"public_addr":"172.21.15.59:6811/753845278","cluster_addr":"172.21.15.59:6813/753845278","heartbeat_back_addr":"172.21.15.59:6817/753845278","heartbeat_front_addr":"172.21.15.59:6815/753845278","state":["exists"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6803","nonce":2997471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6807","nonce":2997471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6822","nonce":2997471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6814","nonce":2997471095}]},"public_addr":"172.21.15.136:6803/2997471095","cluster_addr":"172.21.15.136:6807/2997471095","heartbeat_back_addr":"172.21.15.136:6822/2997471095","heartbeat_front_addr":"172.21.15.136:6814/2997471095","state":["exists","up"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":95,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6811","nonce":4003882581}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6816","nonce":4003882581}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6823","nonce":4003882581}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":4003882581},{"type":"v1","addr":"172.21.15.142:6821","nonce":4003882581}]},"public_addr":"172.21.15.142:6811/4003882581","cluster_addr":"172.21.15.142:6816/4003882581","heartbeat_back_addr":"172.21.15.142:6823/4003882581","heartbeat_front_addr":"172.21.15.142:6821/4003882581","state":["exists"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6817","nonce":1433451080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6819","nonce":1433451080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6823","nonce":1433451080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6821","nonce":1433451080}]},"public_addr":"172.21.15.175:6817/1433451080","cluster_addr":"172.21.15.175:6819/1433451080","heartbeat_back_addr":"172.21.15.175:6823/1433451080","heartbeat_front_addr":"172.21.15.175:6821/1433451080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:55.274534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:52.961841+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:02.389817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:10.876094+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:48.117738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:56.417195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.697164+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.415959+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.115446+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:03.922985+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:45.047241+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:52.261043+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":65536,"last_purged_snaps_scrub":"2024-04-26T02:24:52.059834+0000","dead_epoch":107},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:52.745021+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:23:43.969599+0000","dead_epoch":95},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:01.474486+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[{"pgid":"3.c","osds":[0,7,2147483647,1,9,3,15]},{"pgid":"3.d","osds":[2147483647,4,9,0,8,7,2147483647]}],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":26,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":36,"length":4},{"begin":41,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":41,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:25:17.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:25:17.200 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:17.201 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:17.215 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T02:25:17.270 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-26T02:25:17.264+0000 7f89a9e66640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25324) UID: 0 2024-04-26T02:25:17.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T02:25:17.335 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:17.335 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:17.337 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-14 --journal-path /var/lib/ceph/osd/ceph-14/journal --op export --pgid 2.3 --file /var/log/ceph/exp.2.3.14 2024-04-26T02:25:17.349 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-26T02:25:17.395 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-26T02:25:17.395+0000 7fd73f077640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25080) UID: 0 2024-04-26T02:25:17.448 INFO:teuthology.orchestra.run.smithi059.stdout:osd.0: {} 2024-04-26T02:25:17.448 INFO:teuthology.orchestra.run.smithi059.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T02:25:17.468 INFO:teuthology.orchestra.run.smithi059.stdout:osd.1: {} 2024-04-26T02:25:17.469 INFO:teuthology.orchestra.run.smithi059.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T02:25:17.470 INFO:teuthology.orchestra.run.smithi136.stdout:ERROR: (22) Invalid argument 2024-04-26T02:25:17.471 INFO:teuthology.orchestra.run.smithi136.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T02:25:17.471 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:17.466+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:17.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-26T02:25:17.487 INFO:teuthology.orchestra.run.smithi059.stdout:osd.2: {} 2024-04-26T02:25:17.488 INFO:teuthology.orchestra.run.smithi059.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T02:25:17.508 INFO:teuthology.orchestra.run.smithi059.stdout:osd.3: {} 2024-04-26T02:25:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-26T02:25:17.526 INFO:teuthology.orchestra.run.smithi059.stdout:osd.4: {} 2024-04-26T02:25:17.527 INFO:teuthology.orchestra.run.smithi059.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-26T02:25:17.545 INFO:teuthology.orchestra.run.smithi059.stdout:osd.5: {} 2024-04-26T02:25:17.546 INFO:teuthology.orchestra.run.smithi059.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-26T02:25:17.567 INFO:teuthology.orchestra.run.smithi059.stdout:osd.6: {} 2024-04-26T02:25:17.568 INFO:teuthology.orchestra.run.smithi059.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-26T02:25:17.569 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:25:17.569 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:25:17.572 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:17.566+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:17.594 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-04-26T02:25:16.733199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":152666656,"num_objects":127,"num_object_clones":78,"num_object_copies":879,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":127,"num_whiteouts":9,"num_read":496,"num_read_kb":150991,"num_write":1110,"num_write_kb":157460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1412,"ondisk_log_size":1412,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":15,"num_per_pool_osds":15,"num_per_pool_omap_osds":15,"kb":1415577600,"kb_used":737360,"kb_used_data":250160,"kb_used_omap":23,"kb_used_meta":486952,"kb_avail":1414840240,"statfs":{"total":1449551462400,"available":1448796405760,"internally_reserved":0,"allocated":256163840,"data_stored":386588342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23922,"internal_metadata":498639502},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1327104,"num_objects":9,"num_object_clones":9,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":2,"num_read":20,"num_read_kb":13617,"num_write":57,"num_write_kb":1296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001176"},"pg_stats":[{"pgid":"3.f","version":"100'92","reported_seq":443,"reported_epoch":106,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:13.547880+0000","last_change":"2024-04-26T02:25:03.493596+0000","last_active":"2024-04-26T02:25:13.547880+0000","last_peered":"2024-04-26T02:25:13.547880+0000","last_clean":"2024-04-26T02:25:01.636714+0000","last_became_active":"2024-04-26T02:25:03.493596+0000","last_became_peered":"2024-04-26T02:25:03.493596+0000","last_unstale":"2024-04-26T02:25:13.547880+0000","last_undegraded":"2024-04-26T02:25:03.481645+0000","last_fullsized":"2024-04-26T02:25:03.481246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":6,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.029470227000000002,"stat_sum":{"num_bytes":13729792,"num_objects":10,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":10,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":33,"num_read_kb":9132,"num_write":78,"num_write_kb":15344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,13,5,2147483647,2,1,3],"acting":[0,13,5,2147483647,2,1,3],"avail_no_missing":["0(0)","1(5)","2(4)","3(6)","5(2)","13(1)"],"object_location_counts":[{"shards":"0(0),1(5),2(4),3(6),5(2),13(1)","objects":10}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"92'81","reported_seq":421,"reported_epoch":104,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:11.552115+0000","last_change":"2024-04-26T02:25:03.502150+0000","last_active":"2024-04-26T02:25:11.552115+0000","last_peered":"2024-04-26T02:25:11.552115+0000","last_clean":"2024-04-26T02:25:01.639988+0000","last_became_active":"2024-04-26T02:25:03.502150+0000","last_became_peered":"2024-04-26T02:25:03.502150+0000","last_unstale":"2024-04-26T02:25:11.552115+0000","last_undegraded":"2024-04-26T02:25:03.494577+0000","last_fullsized":"2024-04-26T02:25:03.490346+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:25.797540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.020095757999999998,"stat_sum":{"num_bytes":11141120,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":1009,"num_write":55,"num_write_kb":11440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2147483647,6,4,11,9,15],"acting":[13,2147483647,6,4,11,9,15],"avail_no_missing":["13(0)","4(3)","6(2)","9(5)","11(4)","15(6)"],"object_location_counts":[{"shards":"4(3),6(2),9(5),11(4),13(0),15(6)","objects":6}],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"}]},{"pgid":"3.d","version":"106'125","reported_seq":493,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-04-26T02:25:13.583582+0000","last_change":"2024-04-26T02:25:13.585571+0000","last_active":"2024-04-26T02:25:13.583582+0000","last_peered":"2024-04-26T02:25:13.583582+0000","last_clean":"2024-04-26T02:25:13.583582+0000","last_became_active":"2024-04-26T02:24:00.149537+0000","last_became_peered":"2024-04-26T02:24:00.149537+0000","last_unstale":"2024-04-26T02:25:14.552714+0000","last_undegraded":"2024-04-26T02:25:13.583582+0000","last_fullsized":"2024-04-26T02:25:13.583582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.313959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.031449613000000001,"stat_sum":{"num_bytes":22118400,"num_objects":11,"num_object_clones":6,"num_object_copies":77,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":36,"num_read_kb":16482,"num_write":77,"num_write_kb":19200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,9,0,8,7,3],"acting":[12,4,9,0,8,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"1"},{"start":"1f","length":"1"},{"start":"24","length":"3"}]},{"pgid":"3.c","version":"106'243","reported_seq":608,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T02:25:13.610866+0000","last_change":"2024-04-26T02:25:13.600254+0000","last_active":"2024-04-26T02:25:13.610866+0000","last_peered":"2024-04-26T02:25:13.610866+0000","last_clean":"2024-04-26T02:25:13.610866+0000","last_became_active":"2024-04-26T02:24:00.146833+0000","last_became_peered":"2024-04-26T02:24:00.146833+0000","last_unstale":"2024-04-26T02:25:13.610866+0000","last_undegraded":"2024-04-26T02:25:13.610866+0000","last_fullsized":"2024-04-26T02:25:13.610866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.052857464,"stat_sum":{"num_bytes":27197440,"num_objects":26,"num_object_clones":18,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":4,"num_read":71,"num_read_kb":51153,"num_write":146,"num_write_kb":26560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,12,1,9,3,15],"acting":[0,7,12,1,9,3,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"1"},{"start":"1f","length":"1"},{"start":"24","length":"3"}]},{"pgid":"3.b","version":"104'39","reported_seq":377,"reported_epoch":104,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:11.553918+0000","last_change":"2024-04-26T02:25:03.493663+0000","last_active":"2024-04-26T02:25:11.553918+0000","last_peered":"2024-04-26T02:25:11.553918+0000","last_clean":"2024-04-26T02:25:01.640871+0000","last_became_active":"2024-04-26T02:25:03.493663+0000","last_became_peered":"2024-04-26T02:25:03.493663+0000","last_unstale":"2024-04-26T02:25:11.553918+0000","last_undegraded":"2024-04-26T02:25:03.482929+0000","last_fullsized":"2024-04-26T02:25:03.482106+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:20.601760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019995490000000002,"stat_sum":{"num_bytes":3309568,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":8,"num_read_kb":5,"num_write":58,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,15,10,12,1,4,2147483647],"acting":[7,15,10,12,1,4,2147483647],"avail_no_missing":["7(0)","1(4)","4(5)","10(2)","12(3)","15(1)"],"object_location_counts":[{"shards":"1(4),4(5),7(0),10(2),12(3),15(1)","objects":6}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"}]},{"pgid":"3.a","version":"106'86","reported_seq":443,"reported_epoch":106,"state":"stale+active+clean","last_fresh":"2024-04-26T02:25:13.590547+0000","last_change":"2024-04-26T02:25:13.581947+0000","last_active":"2024-04-26T02:25:13.590547+0000","last_peered":"2024-04-26T02:25:13.590547+0000","last_clean":"2024-04-26T02:25:13.590547+0000","last_became_active":"2024-04-26T02:24:00.089519+0000","last_became_peered":"2024-04-26T02:24:00.089519+0000","last_unstale":"2024-04-26T02:25:14.552716+0000","last_undegraded":"2024-04-26T02:25:13.590547+0000","last_fullsized":"2024-04-26T02:25:13.590547+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.028633498,"stat_sum":{"num_bytes":8028160,"num_objects":7,"num_object_clones":4,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":12,"num_read_kb":7,"num_write":96,"num_write_kb":8304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,4,6,10,13,1,8],"acting":[12,4,6,10,13,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"1"},{"start":"1f","length":"1"},{"start":"24","length":"3"}]},{"pgid":"3.9","version":"103'72","reported_seq":431,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T02:25:11.551900+0000","last_change":"2024-04-26T02:25:10.558313+0000","last_active":"2024-04-26T02:25:11.551900+0000","last_peered":"2024-04-26T02:25:11.551900+0000","last_clean":"2024-04-26T02:25:11.551900+0000","last_became_active":"2024-04-26T02:24:00.306359+0000","last_became_peered":"2024-04-26T02:24:00.306359+0000","last_unstale":"2024-04-26T02:25:11.551900+0000","last_undegraded":"2024-04-26T02:25:11.551900+0000","last_fullsized":"2024-04-26T02:25:11.551900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011833573999999999,"stat_sum":{"num_bytes":9502720,"num_objects":9,"num_object_clones":6,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":24,"num_read_kb":370,"num_write":63,"num_write_kb":10544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,2,10,9,4,11,0],"acting":[13,2,10,9,4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"4"},{"start":"24","length":"2"}]},{"pgid":"3.8","version":"103'107","reported_seq":461,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T02:25:11.552820+0000","last_change":"2024-04-26T02:25:10.541523+0000","last_active":"2024-04-26T02:25:11.552820+0000","last_peered":"2024-04-26T02:25:11.552820+0000","last_clean":"2024-04-26T02:25:11.552820+0000","last_became_active":"2024-04-26T02:24:00.370498+0000","last_became_peered":"2024-04-26T02:24:00.370498+0000","last_unstale":"2024-04-26T02:25:11.552820+0000","last_undegraded":"2024-04-26T02:25:11.552820+0000","last_fullsized":"2024-04-26T02:25:11.552820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:22.415592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.007448517,"stat_sum":{"num_bytes":9994240,"num_objects":10,"num_object_clones":6,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12493,"num_write":57,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,10,15,0,5],"acting":[6,7,1,10,15,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"4"},{"start":"24","length":"2"}]},{"pgid":"1.0","version":"26'157","reported_seq":371,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T02:25:11.552884+0000","last_change":"2024-04-26T02:25:05.423284+0000","last_active":"2024-04-26T02:25:11.552884+0000","last_peered":"2024-04-26T02:25:11.552884+0000","last_clean":"2024-04-26T02:25:11.552884+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:25:11.552884+0000","last_undegraded":"2024-04-26T02:25:11.552884+0000","last_fullsized":"2024-04-26T02:25:11.552884+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-26T02:25:05.423186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:25:05.423186+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:09.427194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":28,"reported_epoch":106,"state":"active+undersized","last_fresh":"2024-04-26T02:25:13.546697+0000","last_change":"2024-04-26T02:25:03.482254+0000","last_active":"2024-04-26T02:25:13.546697+0000","last_peered":"2024-04-26T02:25:13.546697+0000","last_clean":"2024-04-26T02:23:49.896447+0000","last_became_active":"2024-04-26T02:25:03.482254+0000","last_became_peered":"2024-04-26T02:25:03.482254+0000","last_unstale":"2024-04-26T02:25:13.546697+0000","last_undegraded":"2024-04-26T02:25:13.546697+0000","last_fullsized":"2024-04-26T02:25:03.481316+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.730637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"101'72","reported_seq":389,"reported_epoch":104,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:11.678382+0000","last_change":"2024-04-26T02:25:03.494156+0000","last_active":"2024-04-26T02:25:11.678382+0000","last_peered":"2024-04-26T02:25:11.678382+0000","last_clean":"2024-04-26T02:24:57.523928+0000","last_became_active":"2024-04-26T02:25:03.494156+0000","last_became_peered":"2024-04-26T02:25:03.494156+0000","last_unstale":"2024-04-26T02:25:11.678382+0000","last_undegraded":"2024-04-26T02:25:03.482831+0000","last_fullsized":"2024-04-26T02:25:03.481977+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.026630029999999999,"stat_sum":{"num_bytes":4046848,"num_objects":7,"num_object_clones":5,"num_object_copies":49,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":7,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":15,"num_read_kb":5984,"num_write":28,"num_write_kb":4272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2147483647,5,0,4,8,10,13],"acting":[2147483647,5,0,4,8,10,13],"avail_no_missing":["5(1)","0(2)","4(3)","8(4)","10(5)","13(6)"],"object_location_counts":[{"shards":"0(2),4(3),5(1),8(4),10(5),13(6)","objects":7}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":174,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T02:25:13.564438+0000","last_change":"2024-04-26T02:24:54.227454+0000","last_active":"2024-04-26T02:25:13.564438+0000","last_peered":"2024-04-26T02:25:13.564438+0000","last_clean":"2024-04-26T02:25:13.564438+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:25:13.564438+0000","last_undegraded":"2024-04-26T02:25:13.564438+0000","last_fullsized":"2024-04-26T02:25:13.564438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:24:54.227284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:24:54.227284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:15.877477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1","version":"106'75","reported_seq":430,"reported_epoch":108,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:15.585672+0000","last_change":"2024-04-26T02:25:03.498539+0000","last_active":"2024-04-26T02:25:15.585672+0000","last_peered":"2024-04-26T02:25:15.585672+0000","last_clean":"2024-04-26T02:25:01.638144+0000","last_became_active":"2024-04-26T02:25:03.498539+0000","last_became_peered":"2024-04-26T02:25:03.498539+0000","last_unstale":"2024-04-26T02:25:15.585672+0000","last_undegraded":"2024-04-26T02:25:03.486485+0000","last_fullsized":"2024-04-26T02:25:03.485772+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:17.038742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.012090386,"stat_sum":{"num_bytes":11517952,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":27,"num_read_kb":25981,"num_write":34,"num_write_kb":11936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,2147483647,10,9,1,3],"acting":[11,4,2147483647,10,9,1,3],"avail_no_missing":["11(0)","1(5)","3(6)","4(1)","9(4)","10(3)"],"object_location_counts":[{"shards":"1(5),3(6),4(1),9(4),10(3),11(0)","objects":8}],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":104,"state":"active+undersized","last_fresh":"2024-04-26T02:25:11.559217+0000","last_change":"2024-04-26T02:25:03.491280+0000","last_active":"2024-04-26T02:25:11.559217+0000","last_peered":"2024-04-26T02:25:11.559217+0000","last_clean":"2024-04-26T02:23:49.896447+0000","last_became_active":"2024-04-26T02:25:03.491280+0000","last_became_peered":"2024-04-26T02:25:03.491280+0000","last_unstale":"2024-04-26T02:25:11.559217+0000","last_undegraded":"2024-04-26T02:25:11.559217+0000","last_fullsized":"2024-04-26T02:25:03.486731+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.762086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15],"acting":[15],"avail_no_missing":["15"],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.0","version":"93'53","reported_seq":392,"reported_epoch":104,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:11.560089+0000","last_change":"2024-04-26T02:25:03.498062+0000","last_active":"2024-04-26T02:25:11.560089+0000","last_peered":"2024-04-26T02:25:11.560089+0000","last_clean":"2024-04-26T02:25:01.947384+0000","last_became_active":"2024-04-26T02:25:03.498062+0000","last_became_peered":"2024-04-26T02:25:03.498062+0000","last_unstale":"2024-04-26T02:25:11.560089+0000","last_undegraded":"2024-04-26T02:25:03.484903+0000","last_fullsized":"2024-04-26T02:25:03.484568+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:18.258062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053547259999999998,"stat_sum":{"num_bytes":8994816,"num_objects":5,"num_object_clones":2,"num_object_copies":35,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":15,"num_read_kb":2361,"num_write":28,"num_write_kb":8784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,9,4,2,6,2147483647,15],"acting":[1,9,4,2,6,2147483647,15],"avail_no_missing":["1(0)","2(3)","4(2)","6(4)","9(1)","15(6)"],"object_location_counts":[{"shards":"1(0),2(3),4(2),6(4),9(1),15(6)","objects":5}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T02:25:13.565387+0000","last_change":"2024-04-26T02:23:50.972164+0000","last_active":"2024-04-26T02:25:13.565387+0000","last_peered":"2024-04-26T02:25:13.565387+0000","last_clean":"2024-04-26T02:25:13.565387+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:25:13.565387+0000","last_undegraded":"2024-04-26T02:25:13.565387+0000","last_fullsized":"2024-04-26T02:25:13.565387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:14.819734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":379,"reported_epoch":108,"state":"active+undersized","last_fresh":"2024-04-26T02:25:15.587888+0000","last_change":"2024-04-26T02:25:15.587473+0000","last_active":"2024-04-26T02:25:15.587888+0000","last_peered":"2024-04-26T02:25:15.587888+0000","last_clean":"2024-04-26T02:25:13.562016+0000","last_became_active":"2024-04-26T02:25:15.587473+0000","last_became_peered":"2024-04-26T02:25:15.587473+0000","last_unstale":"2024-04-26T02:25:15.587888+0000","last_undegraded":"2024-04-26T02:25:15.587888+0000","last_fullsized":"2024-04-26T02:25:15.566338+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:04.992396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:25:04.992396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":1,"last_scrub_duration":1,"scrub_schedule":"no scrub is scheduled","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0.00053766299999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,11,0,1,2,2147483647],"acting":[10,8,11,0,1,2,2147483647],"avail_no_missing":["10(0)","0(3)","1(4)","2(5)","8(1)","11(2)"],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"1"},{"start":"1f","length":"1"},{"start":"24","length":"3"}]},{"pgid":"3.5","version":"106'90","reported_seq":464,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T02:25:13.583911+0000","last_change":"2024-04-26T02:25:13.590770+0000","last_active":"2024-04-26T02:25:13.583911+0000","last_peered":"2024-04-26T02:25:13.583911+0000","last_clean":"2024-04-26T02:25:13.583911+0000","last_became_active":"2024-04-26T02:24:00.373670+0000","last_became_peered":"2024-04-26T02:24:00.373670+0000","last_unstale":"2024-04-26T02:25:13.583911+0000","last_undegraded":"2024-04-26T02:25:13.583911+0000","last_fullsized":"2024-04-26T02:25:13.583911+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:28.084812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.025637862000000001,"stat_sum":{"num_bytes":3473408,"num_objects":8,"num_object_clones":5,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":6416,"num_write":94,"num_write_kb":6736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,15,2,13,7,5],"acting":[8,3,15,2,13,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"1"},{"start":"1f","length":"1"},{"start":"24","length":"3"}]},{"pgid":"2.4","version":"0'0","reported_seq":177,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-26T02:25:15.585031+0000","last_change":"2024-04-26T02:25:06.367563+0000","last_active":"2024-04-26T02:25:15.585031+0000","last_peered":"2024-04-26T02:25:15.585031+0000","last_clean":"2024-04-26T02:25:15.585031+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:25:15.585031+0000","last_undegraded":"2024-04-26T02:25:15.585031+0000","last_fullsized":"2024-04-26T02:25:15.585031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:06.367332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:06.367332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:22.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":350,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T02:25:11.553095+0000","last_change":"2024-04-26T02:25:10.546866+0000","last_active":"2024-04-26T02:25:11.553095+0000","last_peered":"2024-04-26T02:25:11.553095+0000","last_clean":"2024-04-26T02:25:11.553095+0000","last_became_active":"2024-04-26T02:24:00.374731+0000","last_became_peered":"2024-04-26T02:24:00.374731+0000","last_unstale":"2024-04-26T02:25:11.553095+0000","last_undegraded":"2024-04-26T02:25:11.553095+0000","last_fullsized":"2024-04-26T02:25:11.553095+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:16.071306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010881319999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13,11,2,6,10,5],"acting":[7,13,11,2,6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"1a","length":"1"},{"start":"1d","length":"4"},{"start":"24","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T02:25:11.679052+0000","last_change":"2024-04-26T02:23:50.971207+0000","last_active":"2024-04-26T02:25:11.679052+0000","last_peered":"2024-04-26T02:25:11.679052+0000","last_clean":"2024-04-26T02:25:11.679052+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:25:11.679052+0000","last_undegraded":"2024-04-26T02:25:11.679052+0000","last_fullsized":"2024-04-26T02:25:11.679052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:19.214116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"105'48","reported_seq":394,"reported_epoch":107,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:14.561047+0000","last_change":"2024-04-26T02:25:03.494468+0000","last_active":"2024-04-26T02:25:14.561047+0000","last_peered":"2024-04-26T02:25:14.561047+0000","last_clean":"2024-04-26T02:25:01.642719+0000","last_became_active":"2024-04-26T02:25:03.494468+0000","last_became_peered":"2024-04-26T02:25:03.494468+0000","last_unstale":"2024-04-26T02:25:14.561047+0000","last_undegraded":"2024-04-26T02:25:03.484649+0000","last_fullsized":"2024-04-26T02:25:03.483635+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:18.151572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017329579999999999,"stat_sum":{"num_bytes":3047424,"num_objects":6,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":14,"num_read_kb":8813,"num_write":36,"num_write_kb":2928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13,6,7,2147483647,10,0],"acting":[3,13,6,7,2147483647,10,0],"avail_no_missing":["3(0)","0(6)","6(2)","7(3)","10(5)","13(1)"],"object_location_counts":[{"shards":"0(6),3(0),6(2),7(3),10(5),13(1)","objects":6}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":162,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-26T02:25:11.559751+0000","last_change":"2024-04-26T02:23:50.925457+0000","last_active":"2024-04-26T02:25:11.559751+0000","last_peered":"2024-04-26T02:25:11.559751+0000","last_clean":"2024-04-26T02:25:11.559751+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:25:11.559751+0000","last_undegraded":"2024-04-26T02:25:11.559751+0000","last_fullsized":"2024-04-26T02:25:11.559751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:23:49.896447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:13.156041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"3.6","version":"102'72","reported_seq":418,"reported_epoch":104,"state":"active+undersized+degraded","last_fresh":"2024-04-26T02:25:11.560177+0000","last_change":"2024-04-26T02:25:03.494914+0000","last_active":"2024-04-26T02:25:11.560177+0000","last_peered":"2024-04-26T02:25:11.560177+0000","last_clean":"2024-04-26T02:25:01.947392+0000","last_became_active":"2024-04-26T02:25:03.494914+0000","last_became_peered":"2024-04-26T02:25:03.494914+0000","last_unstale":"2024-04-26T02:25:11.560177+0000","last_undegraded":"2024-04-26T02:25:03.487853+0000","last_fullsized":"2024-04-26T02:25:03.486788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:58.960646+0000","last_clean_scrub_stamp":"2024-04-26T02:23:58.960646+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.018942216000000001,"stat_sum":{"num_bytes":15974400,"num_objects":6,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":10667,"num_write":57,"num_write_kb":15936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,2147483647,6,2,12,0,1],"acting":[15,2147483647,6,2,12,0,1],"avail_no_missing":["15(0)","0(5)","1(6)","2(3)","6(2)","12(4)"],"object_location_counts":[{"shards":"0(5),1(6),2(3),6(2),12(4),15(0)","objects":6}],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"1e","length":"1"},{"start":"20","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-26T02:25:13.564646+0000","last_change":"2024-04-26T02:25:09.329930+0000","last_active":"2024-04-26T02:25:13.564646+0000","last_peered":"2024-04-26T02:25:13.564646+0000","last_clean":"2024-04-26T02:25:13.564646+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:25:13.564646+0000","last_undegraded":"2024-04-26T02:25:13.564646+0000","last_fullsized":"2024-04-26T02:25:13.564646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:09.329781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:09.329781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:32.651765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":152076288,"num_objects":125,"num_object_clones":78,"num_object_copies":875,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":54,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":9,"num_read":360,"num_read_kb":150873,"num_write":907,"num_write_kb":154000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":250646528,"data_stored":402599936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1255,"ondisk_log_size":1255,"up":112,"acting":112,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":10},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215124,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40804,"kb_used_data":9616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331036,"statfs":{"total":96636764160,"available":96594980864,"internally_reserved":0,"allocated":9846784,"data_stored":17262278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215124,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68812,"kb_used_data":19576,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94303028,"statfs":{"total":96636764160,"available":96566300672,"internally_reserved":0,"allocated":20045824,"data_stored":32122566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313236,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51460,"kb_used_data":20280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94320380,"statfs":{"total":96636764160,"available":96584069120,"internally_reserved":0,"allocated":20766720,"data_stored":36355887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280532,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44484,"kb_used_data":13296,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327356,"statfs":{"total":96636764160,"available":96591212544,"internally_reserved":0,"allocated":13615104,"data_stored":20367440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280533,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36424,"kb_used_data":9400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94335416,"statfs":{"total":96636764160,"available":96599465984,"internally_reserved":0,"allocated":9625600,"data_stored":13113424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280533,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56156,"kb_used_data":24976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94315684,"statfs":{"total":96636764160,"available":96579260416,"internally_reserved":0,"allocated":25575424,"data_stored":37352938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":22,"seq":94489280528,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40920,"kb_used_data":13892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330920,"statfs":{"total":96636764160,"available":96594862080,"internally_reserved":0,"allocated":14225408,"data_stored":19439094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,4,5,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280533,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41120,"kb_used_data":14100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330720,"statfs":{"total":96636764160,"available":96594657280,"internally_reserved":0,"allocated":14438400,"data_stored":18699754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,3,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280531,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51776,"kb_used_data":20596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94320064,"statfs":{"total":96636764160,"available":96583745536,"internally_reserved":0,"allocated":21090304,"data_stored":28259818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,6,9,10,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280531,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40500,"kb_used_data":9320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331340,"statfs":{"total":96636764160,"available":96595292160,"internally_reserved":0,"allocated":9543680,"data_stored":15927306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280532,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46760,"kb_used_data":15580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94325080,"statfs":{"total":96636764160,"available":96588881920,"internally_reserved":0,"allocated":15953920,"data_stored":19347466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280531,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48076,"kb_used_data":16892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94323764,"statfs":{"total":96636764160,"available":96587534336,"internally_reserved":0,"allocated":17297408,"data_stored":27811389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,4,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280532,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53492,"kb_used_data":22308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94318348,"statfs":{"total":96636764160,"available":96581988352,"internally_reserved":0,"allocated":22843392,"data_stored":35487293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280532,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41364,"kb_used_data":14344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330476,"statfs":{"total":96636764160,"available":96594407424,"internally_reserved":0,"allocated":14688256,"data_stored":20485610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,6,7,8,9,10,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215124,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75212,"kb_used_data":25984,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94296628,"statfs":{"total":96636764160,"available":96559747072,"internally_reserved":0,"allocated":26607616,"data_stored":44556079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,7,9,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":43634688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24055808,"data_stored":36503552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12918784,"data_stored":17809408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19197952,"data_stored":35434496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18714624,"data_stored":31432704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7491584,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13901824,"data_stored":17928192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15761408,"data_stored":26910720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8355840,"data_stored":16412672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":21307392,"data_stored":34586624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":12029952,"data_stored":19435520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8040448,"data_stored":12181504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":18124800,"data_stored":30101504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":13168640,"data_stored":19595264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":12967936,"data_stored":18714624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":19570688,"data_stored":27410432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:25:17.596 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-26T02:25:17.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-26T02:25:17.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:25:17.597 INFO:teuthology.orchestra.run.smithi059.stdout:osd.7: {} 2024-04-26T02:25:17.598 INFO:teuthology.orchestra.run.smithi059.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-26T02:25:17.616 INFO:teuthology.orchestra.run.smithi059.stdout:osd.8: {} 2024-04-26T02:25:17.616 INFO:teuthology.orchestra.run.smithi059.stderr:osd.8: osd_enable_op_tracker = '' 2024-04-26T02:25:17.638 INFO:teuthology.orchestra.run.smithi059.stdout:osd.9: {} 2024-04-26T02:25:17.638 INFO:teuthology.orchestra.run.smithi059.stderr:osd.9: osd_enable_op_tracker = '' 2024-04-26T02:25:17.654 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:17.654 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:17.654 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:25:17.655 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:25:17.655 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:17.661 INFO:teuthology.orchestra.run.smithi059.stdout:osd.10: {} 2024-04-26T02:25:17.661 INFO:teuthology.orchestra.run.smithi059.stderr:osd.10: osd_enable_op_tracker = '' 2024-04-26T02:25:17.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-26T02:25:17.686 INFO:teuthology.orchestra.run.smithi059.stdout:osd.11: {} 2024-04-26T02:25:17.687 INFO:teuthology.orchestra.run.smithi059.stderr:osd.11: osd_enable_op_tracker = '' 2024-04-26T02:25:17.687 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.12 2024-04-26T02:25:17.709 INFO:teuthology.orchestra.run.smithi059.stdout:osd.13: {} 2024-04-26T02:25:17.709 INFO:teuthology.orchestra.run.smithi059.stderr:osd.13: osd_enable_op_tracker = '' 2024-04-26T02:25:17.709 INFO:teuthology.orchestra.run.smithi059.stderr:Error ENXIO: problem getting command descriptions from osd.14 2024-04-26T02:25:17.715 INFO:tasks.ceph.osd.13.smithi136.stderr:2024-04-26T02:25:17.715+0000 7f988752e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 13 (PID: 25084) UID: 0 2024-04-26T02:25:17.737 INFO:teuthology.orchestra.run.smithi059.stdout:osd.15: {} 2024-04-26T02:25:17.738 INFO:teuthology.orchestra.run.smithi059.stderr:osd.15: osd_enable_op_tracker = '' 2024-04-26T02:25:17.742 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T02:25:17.742 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T02:25:17.774 INFO:tasks.ceph.osd.1.smithi136.stderr:2024-04-26T02:25:17.771+0000 7fc42a947640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25078) UID: 0 2024-04-26T02:25:17.790 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 71.752140267000001, 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073503989999999996, 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.791 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034869+0000", 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034871+0000", 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6700000000000001e-06 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.792 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034923+0000", 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1613000000000002e-05 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034958+0000", 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4913000000000003e-05 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.034979+0000", 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1863000000000001e-05 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.793 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035130+0000", 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000150018 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.035154+0000", 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4615999999999999e-05 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042120+0000", 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069656709999999997 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.794 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.042220+0000", 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000100035 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 38/31 ECSubWrite(tid=181, reqid=osd.6.0:180, at_version=0'0, trim_to=0'0, roll_forward_to=38'17))", 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 71.728980851000003, 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066527089999999997, 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.795 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058029+0000", 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.796 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058037+0000", 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2330000000000006e-06 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058090+0000", 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2769999999999998e-05 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058122+0000", 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2224999999999997e-05 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.797 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058146+0000", 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3924e-05 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058303+0000", 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000157078 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.798 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.058328+0000", 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4485999999999999e-05 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064575+0000", 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062476040000000004 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.064682+0000", 2024-04-26T02:25:17.799 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000106389 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 51.220145881000001, 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085029419999999994, 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.800 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566864+0000", 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566865+0000", 2024-04-26T02:25:17.801 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.023e-06 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566916+0000", 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.1465999999999998e-05 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566933+0000", 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6786000000000002e-05 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.802 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.566944+0000", 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0907000000000001e-05 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569079+0000", 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0021353470000000001 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.569114+0000", 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.4693000000000001e-05 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.803 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575260+0000", 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0061455479999999998 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575367+0000", 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000107172 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 51.213457136000002, 2024-04-26T02:25:17.804 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082705049999999992, 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.805 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573553+0000", 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573606+0000", 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2602999999999998e-05 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573635+0000", 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8873e-05 2024-04-26T02:25:17.806 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.573660+0000", 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4828999999999999e-05 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575052+0000", 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013921319999999999 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.575077+0000", 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5265999999999998e-05 2024-04-26T02:25:17.807 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581726+0000", 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066491959999999996 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.581823+0000", 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6825999999999998e-05 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.808 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 51.208316875000001, 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072766089999999999, 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.809 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578693+0000", 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578694+0000", 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6670000000000001e-06 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578777+0000", 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2946000000000002e-05 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.810 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578804+0000", 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6642999999999999e-05 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578824+0000", 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9962999999999998e-05 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.578977+0000", 2024-04-26T02:25:17.811 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015333799999999999 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.579002+0000", 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4490000000000001e-05 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585878+0000", 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006876137 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:26.585969+0000", 2024-04-26T02:25:17.812 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1425e-05 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 66/31 ECSubWrite(tid=200, reqid=osd.0.0:200, at_version=66'50, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.311139978, 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0078231570000000007, 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.813 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475870+0000", 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.1699999999999997e-07 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.814 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475917+0000", 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6984999999999998e-05 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475950+0000", 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2175000000000003e-05 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475973+0000", 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3822e-05 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.815 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476141+0000", 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000168073 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476167+0000", 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5069e-05 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483535+0000", 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0073683589999999997 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.816 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483693+0000", 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015795699999999999 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.310974477999999, 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085944239999999998, 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.817 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476035+0000", 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476036+0000", 2024-04-26T02:25:17.818 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7699999999999992e-07 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476086+0000", 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0274e-05 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476109+0000", 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2123000000000001e-05 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.819 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476125+0000", 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6804999999999999e-05 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478426+0000", 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002300814 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478460+0000", 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3671999999999999e-05 2024-04-26T02:25:17.820 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484563+0000", 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006102639 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484630+0000", 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.7119999999999994e-05 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.821 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 66/31 ECSubWrite(tid=215, reqid=osd.6.0:215, at_version=66'44, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.310692813000003, 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.007423453, 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.822 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476317+0000", 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7000000000000005e-07 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.823 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476366+0000", 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9001000000000001e-05 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476390+0000", 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3181999999999999e-05 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476410+0000", 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0179000000000001e-05 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476565+0000", 2024-04-26T02:25:17.824 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000155558 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476591+0000", 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5752e-05 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483658+0000", 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0070671969999999999 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483740+0000", 2024-04-26T02:25:17.825 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.2014000000000005e-05 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.309965363000003, 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074208959999999997, 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.826 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477044+0000", 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477046+0000", 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7689999999999999e-06 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.827 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477094+0000", 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7948000000000002e-05 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477127+0000", 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3052000000000001e-05 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.477149+0000", 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2198999999999999e-05 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478668+0000", 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015185140000000001 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.478692+0000", 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4155000000000002e-05 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484377+0000", 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056854990000000001 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.829 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484465+0000", 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.776e-05 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 66/31 ECSubWrite(tid=74, reqid=osd.8.0:74, at_version=66'53, trim_to=0'0, roll_forward_to=59'51))", 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.303434230000001, 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092472439999999999, 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.830 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483575+0000", 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483576+0000", 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.7400000000000003e-07 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.831 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483698+0000", 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000122371 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483731+0000", 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2404999999999999e-05 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.832 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483769+0000", 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7866e-05 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484007+0000", 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00023789300000000001 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484030+0000", 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3836e-05 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.833 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492725+0000", 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0086945890000000008 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492823+0000", 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7709999999999998e-05 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.834 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 66/31 ECSubWrite(tid=22, reqid=osd.14.0:22, at_version=66'22, trim_to=0'0, roll_forward_to=59'18))", 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.303246907999998, 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0090347959999999995, 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483763+0000", 2024-04-26T02:25:17.835 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483765+0000", 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7770000000000001e-06 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483820+0000", 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5084000000000003e-05 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.836 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483844+0000", 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4788999999999999e-05 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483868+0000", 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3339000000000001e-05 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484151+0000", 2024-04-26T02:25:17.837 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00028312500000000001 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.484176+0000", 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4783e-05 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492704+0000", 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085281000000000003 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492798+0000", 2024-04-26T02:25:17.838 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3799000000000001e-05 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.2s1 75/31 ECSubWrite(tid=51, reqid=osd.14.0:51, at_version=75'48, trim_to=0'0, roll_forward_to=74'46))", 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.313645286000003, 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.006684471, 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.839 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473364+0000", 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473365+0000", 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.9999999999999997e-07 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473427+0000", 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1585000000000001e-05 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473459+0000", 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473487+0000", 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8306e-05 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.841 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473645+0000", 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015791500000000001 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.473673+0000", 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7690000000000001e-05 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.479974+0000", 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0063010180000000002 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.842 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:42.480049+0000", 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5020999999999999e-05 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 100/31 ECSubWrite(tid=276, reqid=osd.6.0:276, at_version=100'102, trim_to=0'0, roll_forward_to=98'100))", 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:07.515154+0000", 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.271855970000001, 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0064128029999999999, 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.843 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515154+0000", 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515154+0000", 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.844 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515154+0000", 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.3e-07 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.845 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515209+0000", 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.4938999999999997e-05 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515266+0000", 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6956000000000002e-05 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.846 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515290+0000", 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3405999999999999e-05 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515465+0000", 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017527100000000001 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.515494+0000", 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8543000000000001e-05 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.847 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.521473+0000", 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059796520000000002 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.521567+0000", 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3306000000000004e-05 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs2 100/95 ECSubWrite(tid=345, reqid=client.4589.0:837, at_version=100'92, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:07.526932+0000", 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.260077289, 2024-04-26T02:25:17.848 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0074565229999999996, 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.526932+0000", 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.526932+0000", 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.849 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.526933+0000", 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6400000000000002e-07 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.527135+0000", 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000201943 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.527162+0000", 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7517000000000001e-05 2024-04-26T02:25:17.850 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.527185+0000", 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2385999999999999e-05 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.527404+0000", 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021921000000000001 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.527431+0000", 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7419e-05 2024-04-26T02:25:17.851 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.534285+0000", 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0068531290000000003 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:07.534389+0000", 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104355 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.852 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:839 3.2s1 3:492e5739:::smithi17529564-20:head [append 0~0] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:08.518964+0000", 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2680451979999994, 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012692701000000001, 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 839 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.518964+0000", 2024-04-26T02:25:17.853 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.518964+0000", 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.518967+0000", 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5129999999999999e-06 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.854 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.518979+0000", 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1606999999999999e-05 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.518999+0000", 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0322e-05 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519018+0000", 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.927e-05 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.855 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519165+0000", 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014689099999999999 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519544+0000", 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00037877800000000002 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.521553+0000", 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002008845 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.529537+0000", 2024-04-26T02:25:17.856 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0079843880000000002 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.531011+0000", 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0014740700000000001 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.531657+0000", 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00064601700000000003 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:840 3.2s1 3:492e5739:::smithi17529564-20:head [rollback 24] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:08.519055+0000", 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2679551599999996, 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015544799, 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 840 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.858 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519055+0000", 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519055+0000", 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519056+0000", 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.367e-06 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519063+0000", 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8630000000000002e-06 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519085+0000", 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.19e-05 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519100+0000", 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5549999999999999e-05 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.523641+0000", 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0045406079999999998 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.523833+0000", 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00019178399999999999 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.525193+0000", 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001359912 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.529667+0000", 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0044749359999999997 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.533946+0000", 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0042784069999999997 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.534599+0000", 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00065347199999999999 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.862 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:841 3.2s1 3:492e5739:::smithi17529564-20:head [append 0~0] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:08.519122+0000", 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.2678876040000002, 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016074196999999998, 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 841 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.863 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519122+0000", 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519122+0000", 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519123+0000", 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.187e-06 2024-04-26T02:25:17.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519130+0000", 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.3330000000000002e-06 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519147+0000", 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7785999999999999e-05 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.519160+0000", 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3010000000000001e-05 2024-04-26T02:25:17.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.526895+0000", 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077346050000000003 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.527316+0000", 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00042136700000000002 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.528691+0000", 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001374325 2024-04-26T02:25:17.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.530225+0000", 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0015347659999999999 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.534846+0000", 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046202209999999999 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.535196+0000", 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00035059700000000002 2024-04-26T02:25:17.867 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:925 3.2s1 3:492e5739:::smithi17529564-20:head [delete] snapc 29=[29,28,27,23,22,21,19,10] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e106)", 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:13.556043+0000", 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 4.2309670480000001, 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.028637374, 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 925 2024-04-26T02:25:17.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556043+0000", 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556043+0000", 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556046+0000", 2024-04-26T02:25:17.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0699999999999998e-06 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556059+0000", 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2809000000000001e-05 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556091+0000", 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2595999999999998e-05 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556108+0000", 2024-04-26T02:25:17.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6529999999999999e-05 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556264+0000", 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000156515 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.556279+0000", 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4806e-05 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.562223+0000", 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0059441989999999998 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.562539+0000", 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031595899999999999 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.570553+0000", 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080137579999999993 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.574411+0000", 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003857994 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.584268+0000", 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0098572079999999992 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:13.584680+0000", 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00041193000000000002 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.873 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.8s6 107/31 ECSubWrite(tid=290, reqid=osd.6.0:290, at_version=107'115, trim_to=0'0, roll_forward_to=106'113))", 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:14.560607+0000", 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 3.226402411, 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0089602580000000005, 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560607+0000", 2024-04-26T02:25:17.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560607+0000", 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560608+0000", 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.0999999999999998e-07 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560662+0000", 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.3879999999999999e-05 2024-04-26T02:25:17.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560699+0000", 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7528999999999999e-05 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560721+0000", 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1622999999999999e-05 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560906+0000", 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000185231 2024-04-26T02:25:17.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.560935+0000", 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8886000000000001e-05 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.569473+0000", 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0085382210000000004 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.569568+0000", 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4277999999999994e-05 2024-04-26T02:25:17.877 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.5s6 107/31 ECSubWrite(tid=118, reqid=osd.8.0:118, at_version=107'92, trim_to=0'0, roll_forward_to=106'90))", 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:14.561108+0000", 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 3.2259015280000001, 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0066970939999999998, 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:17.878 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561108+0000", 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561108+0000", 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561110+0000", 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.807e-06 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561165+0000", 2024-04-26T02:25:17.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5299e-05 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561201+0000", 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.536e-05 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561226+0000", 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4932000000000001e-05 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561426+0000", 2024-04-26T02:25:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000200347 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.561442+0000", 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6353000000000001e-05 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.567711+0000", 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0062688010000000001 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:14.567805+0000", 2024-04-26T02:25:17.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4195000000000002e-05 2024-04-26T02:25:17.882 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.882 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.882 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.882 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:17.882 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:17.882 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:17.884 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_ops_in_flight 2024-04-26T02:25:17.884 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:17.878+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:17.984 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-26T02:25:17.976+0000 7f5eee913640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25326) UID: 0 2024-04-26T02:25:18.063 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:18.063 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:18.063 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:25:18.063 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:18.077 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_blocked_ops 2024-04-26T02:25:18.085 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-26T02:25:18.082+0000 7fbb6061b640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25079) UID: 0 2024-04-26T02:25:18.186 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:18.182+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:18.198 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:18.198 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:18.199 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:25:18.199 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:25:18.199 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:18.213 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.9.asok dump_historic_ops 2024-04-26T02:25:18.288 INFO:tasks.ceph.osd.2.smithi142.stderr:2024-04-26T02:25:18.282+0000 7f499f7b6640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25079) UID: 0 2024-04-26T02:25:18.339 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:18.339 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:25:18.339 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:25:18.339 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:25:18.339 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=61, reqid=osd.0.0:61, at_version=37'27, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 73.295884083999994, 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010661271, 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.340 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041761+0000", 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041762+0000", 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.44e-07 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041818+0000", 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6208999999999997e-05 2024-04-26T02:25:18.341 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041850+0000", 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2236000000000001e-05 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041876+0000", 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5426999999999999e-05 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.342 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042091+0000", 2024-04-26T02:25:18.343 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021539399999999999 2024-04-26T02:25:18.343 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.343 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.344 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.344 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042116+0000", 2024-04-26T02:25:18.344 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4403e-05 2024-04-26T02:25:18.344 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052304+0000", 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010188236999999999 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.052423+0000", 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00011882100000000001 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.345 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 37/31 ECSubWrite(tid=62, reqid=osd.0.0:62, at_version=37'29, trim_to=0'0, roll_forward_to=36'25))", 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 73.295696656000004, 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012114710000000001, 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.346 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.347 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041949+0000", 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041950+0000", 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.348 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.041995+0000", 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.4988999999999999e-05 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042019+0000", 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4712999999999999e-05 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.042038+0000", 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8773000000000001e-05 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.349 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045071+0000", 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.003033015 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.045096+0000", 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4607e-05 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.053959+0000", 2024-04-26T02:25:18.350 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0088630800000000006 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:05.054064+0000", 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000104576 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 66/31 ECSubWrite(tid=145, reqid=osd.12.0:145, at_version=66'60, trim_to=0'0, roll_forward_to=65'56))", 2024-04-26T02:25:18.351 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.867598923000003, 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017047870999999999, 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470047+0000", 2024-04-26T02:25:18.352 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470048+0000", 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.083e-06 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470109+0000", 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1620999999999998e-05 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470135+0000", 2024-04-26T02:25:18.353 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5344999999999999e-05 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470154+0000", 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9836000000000001e-05 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472084+0000", 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001929343 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472117+0000", 2024-04-26T02:25:18.354 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3411999999999998e-05 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.486997+0000", 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014879618000000001 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.487094+0000", 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7613000000000002e-05 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.355 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=201, reqid=osd.0.0:201, at_version=66'104, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.861317722000003, 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012116203000000001, 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.356 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476328+0000", 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:25:18.357 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476376+0000", 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7428000000000001e-05 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476400+0000", 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4258999999999999e-05 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476420+0000", 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9656e-05 2024-04-26T02:25:18.358 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476577+0000", 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015684299999999999 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.476602+0000", 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5752e-05 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488347+0000", 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011744378999999999 2024-04-26T02:25:18.359 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.488444+0000", 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7195999999999996e-05 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.857831011000002, 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010307349, 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.360 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479814+0000", 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.361 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479816+0000", 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479872+0000", 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6118e-05 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479901+0000", 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9000999999999999e-05 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.362 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.365 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.365 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.479922+0000", 2024-04-26T02:25:18.365 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1002999999999999e-05 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480270+0000", 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034741900000000002 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.480293+0000", 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3592e-05 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.366 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490051+0000", 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0097579220000000005 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490122+0000", 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0541000000000001e-05 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 66/31 ECSubWrite(tid=52, reqid=osd.11.0:52, at_version=66'38, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:25:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.845977980000001, 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014479226, 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491667+0000", 2024-04-26T02:25:18.368 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491668+0000", 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.0699999999999996e-07 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491726+0000", 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.8114e-05 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491758+0000", 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1708999999999997e-05 2024-04-26T02:25:18.369 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491781+0000", 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3102e-05 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.491988+0000", 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00020686399999999999 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492015+0000", 2024-04-26T02:25:18.370 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6565999999999999e-05 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506059+0000", 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014044401999999999 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506147+0000", 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7762000000000004e-05 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.371 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.372 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.372 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.372 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 66/31 ECSubWrite(tid=89, reqid=osd.13.0:89, at_version=66'42, trim_to=0'0, roll_forward_to=65'38))", 2024-04-26T02:25:18.372 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:25:18.372 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.845099220000002, 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013675405999999999, 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:25:18.373 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492546+0000", 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492548+0000", 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7099999999999999e-06 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.374 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.492635+0000", 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6942999999999997e-05 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493144+0000", 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00050879899999999999 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493171+0000", 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7075000000000001e-05 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.375 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493329+0000", 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015824 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493353+0000", 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4212000000000001e-05 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506165+0000", 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012812161000000001 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.376 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506222+0000", 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6266e-05 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.es5 66/31 ECSubWrite(tid=90, reqid=osd.13.0:87, at_version=0'0, trim_to=0'0, roll_forward_to=66'26))", 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.844071476000003, 2024-04-26T02:25:18.377 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012679335999999999, 2024-04-26T02:25:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.378 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493574+0000", 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.379 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493576+0000", 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8899999999999999e-06 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493604+0000", 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7691999999999998e-05 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.380 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493653+0000", 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9407999999999999e-05 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493678+0000", 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4966000000000001e-05 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.381 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493892+0000", 2024-04-26T02:25:18.382 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000214494 2024-04-26T02:25:18.382 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.382 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.382 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.382 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493917+0000", 2024-04-26T02:25:18.382 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4229000000000001e-05 2024-04-26T02:25:18.382 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506175+0000", 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012258290999999999 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506253+0000", 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8366000000000002e-05 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.383 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.1s4 66/31 ECSubWrite(tid=53, reqid=osd.11.0:53, at_version=66'40, trim_to=0'0, roll_forward_to=59'36))", 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.843890784000003, 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015128608, 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.384 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493755+0000", 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493756+0000", 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493809+0000", 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2507999999999999e-05 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.385 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493837+0000", 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8051999999999998e-05 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.493863+0000", 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5559e-05 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495037+0000", 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0011746879999999999 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.386 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495063+0000", 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5641999999999999e-05 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508808+0000", 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013744869 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508883+0000", 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5537000000000005e-05 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.387 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.843380664999998, 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012858193, 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.388 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494265+0000", 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494266+0000", 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7099999999999999e-06 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.389 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494292+0000", 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5148999999999999e-05 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494322+0000", 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0052e-05 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.390 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494363+0000", 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0825000000000003e-05 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494552+0000", 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018990500000000001 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.494575+0000", 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2969e-05 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.391 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.507077+0000", 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012501134000000001 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.507123+0000", 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6449000000000002e-05 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=205, reqid=osd.0.0:205, at_version=66'108, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:18.392 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.842007432000003, 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013207474, 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.393 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495638+0000", 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495640+0000", 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.79e-06 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495692+0000", 2024-04-26T02:25:18.394 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2676999999999997e-05 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495733+0000", 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0098999999999997e-05 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495756+0000", 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.3289e-05 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.395 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495971+0000", 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021559699999999999 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.495996+0000", 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4975999999999999e-05 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508761+0000", 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012764538000000001 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.396 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.508845+0000", 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4507999999999998e-05 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 66/31 ECSubWrite(tid=206, reqid=osd.0.0:206, at_version=66'110, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 44.840887053000003, 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016729174999999999, 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.397 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496758+0000", 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496760+0000", 2024-04-26T02:25:18.398 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0940000000000002e-06 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496810+0000", 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.9588e-05 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496842+0000", 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1780999999999999e-05 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.496864+0000", 2024-04-26T02:25:18.399 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.23e-05 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506108+0000", 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0092442960000000008 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.506124+0000", 2024-04-26T02:25:18.400 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5327000000000001e-05 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.513404+0000", 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072804300000000001 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.513488+0000", 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3358999999999999e-05 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.401 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.ds2 85/31 ECSubWrite(tid=197, reqid=osd.12.0:197, at_version=85'95, trim_to=0'0, roll_forward_to=83'91))", 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.476366+0000", 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.861279661000001, 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0099852940000000005, 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.402 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476366+0000", 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476366+0000", 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.403 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476367+0000", 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.5999999999999991e-07 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476408+0000", 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1588999999999998e-05 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.404 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476433+0000", 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4842999999999999e-05 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.476452+0000", 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8403e-05 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.478686+0000", 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022340400000000001 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.405 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.478712+0000", 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.597e-05 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.486258+0000", 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075463170000000003 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.486351+0000", 2024-04-26T02:25:18.406 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.3171999999999995e-05 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 85/31 ECSubWrite(tid=267, reqid=osd.0.0:267, at_version=85'140, trim_to=0'0, roll_forward_to=84'136))", 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.484715+0000", 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 25.852930854, 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011963942999999999, 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.407 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484715+0000", 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484715+0000", 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484716+0000", 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.408 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484765+0000", 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8999000000000003e-05 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484791+0000", 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5922999999999999e-05 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.484812+0000", 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0945999999999999e-05 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.409 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.489571+0000", 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047585320000000002 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.489597+0000", 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6316e-05 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.496595+0000", 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0069977850000000003 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.410 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.496679+0000", 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3922000000000001e-05 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.411 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=309, reqid=client.4589.0:769, at_version=92'163, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 18.709659697999999, 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010634701, 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.412 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.413 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.413 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:18.413 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.413 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.413 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.414 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:18.414 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.414 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.414 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.414 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.627986+0000", 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.3e-07 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628578+0000", 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000592002 2024-04-26T02:25:18.415 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628625+0000", 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6808999999999999e-05 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628650+0000", 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4573e-05 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628860+0000", 2024-04-26T02:25:18.416 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00021052199999999999 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.628888+0000", 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8007000000000001e-05 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.638536+0000", 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0096479159999999994 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.417 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.638620+0000", 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.4241999999999997e-05 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=312, reqid=osd.0.0:312, at_version=92'165, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.629743+0000", 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 18.707902154999999, 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012450954, 2024-04-26T02:25:18.418 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629743+0000", 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.419 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629743+0000", 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629745+0000", 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.767e-06 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629797+0000", 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2034999999999999e-05 2024-04-26T02:25:18.420 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629829+0000", 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2166999999999999e-05 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.629854+0000", 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5185999999999999e-05 2024-04-26T02:25:18.421 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630436+0000", 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00058201900000000003 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630528+0000", 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1185000000000002e-05 2024-04-26T02:25:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642097+0000", 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011569322999999999 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642194+0000", 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7272e-05 2024-04-26T02:25:18.423 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=313, reqid=osd.0.0:313, at_version=92'167, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.630702+0000", 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 18.706943713000001, 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011648366, 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.424 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.425 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630702+0000", 2024-04-26T02:25:18.425 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.425 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.425 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.425 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630702+0000", 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630703+0000", 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.753e-06 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630754+0000", 2024-04-26T02:25:18.426 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.0989000000000003e-05 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630784+0000", 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.9366999999999999e-05 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.630809+0000", 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5452e-05 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.631492+0000", 2024-04-26T02:25:18.427 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00068237799999999998 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.631516+0000", 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4419000000000001e-05 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642207+0000", 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010690804 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.428 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.642350+0000", 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014320399999999999 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.cs4 92/31 ECSubWrite(tid=314, reqid=client.4589.0:770, at_version=92'168, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.637048+0000", 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 18.700597304999999, 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011100059000000001, 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.429 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637048+0000", 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637048+0000", 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637050+0000", 2024-04-26T02:25:18.430 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6199999999999999e-06 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637391+0000", 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00034114099999999999 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637424+0000", 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.3535999999999999e-05 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.431 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.637447+0000", 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2782999999999999e-05 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.639043+0000", 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00159553 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.432 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.639069+0000", 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6282999999999999e-05 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.648054+0000", 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0089850180000000009 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.648148+0000", 2024-04-26T02:25:18.433 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.4147999999999994e-05 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 95/31 ECSubWrite(tid=167, reqid=osd.13.0:167, at_version=95'58, trim_to=0'0, roll_forward_to=93'56))", 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:02.478389+0000", 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 15.859256310999999, 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010729288, 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.434 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.435 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.435 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.435 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.435 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.435 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478389+0000", 2024-04-26T02:25:18.435 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478389+0000", 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478390+0000", 2024-04-26T02:25:18.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1710000000000001e-06 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478426+0000", 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.5386000000000003e-05 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478441+0000", 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5670000000000001e-05 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.437 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478454+0000", 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.2833000000000001e-05 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478708+0000", 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00025374499999999999 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.478739+0000", 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1016000000000003e-05 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.438 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.489072+0000", 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010332604 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.489118+0000", 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.6863000000000002e-05 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.9s3 95/31 ECSubWrite(tid=168, reqid=osd.13.0:168, at_version=95'60, trim_to=0'0, roll_forward_to=93'56))", 2024-04-26T02:25:18.439 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:02.479940+0000", 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 15.857705327, 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.011676845999999999, 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479940+0000", 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479940+0000", 2024-04-26T02:25:18.440 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479941+0000", 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6400000000000001e-07 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479966+0000", 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.5199e-05 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.441 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479980+0000", 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3732e-05 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.479990+0000", 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.7890000000000006e-06 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.442 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.480896+0000", 2024-04-26T02:25:18.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00090580200000000004 2024-04-26T02:25:18.443 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.443 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.443 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.443 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.480909+0000", 2024-04-26T02:25:18.443 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.3407000000000001e-05 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.491569+0000", 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010660484 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.444 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:02.491617+0000", 2024-04-26T02:25:18.445 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7568999999999998e-05 2024-04-26T02:25:18.445 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.445 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.445 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.445 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.445 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.445 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:18.447 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_ops_in_flight 2024-04-26T02:25:18.448 INFO:tasks.ceph.osd.8.smithi059.stderr:2024-04-26T02:25:18.446+0000 7f2326a36640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 25083) UID: 0 2024-04-26T02:25:18.523 INFO:teuthology.orchestra.run.smithi142.stderr:Exporting 2.3 info 2.3( empty local-lis/les=26/27 n=0 ec=26/26 lis/c=26/26 les/c/f=27/27/0 sis=26) 2024-04-26T02:25:18.524 INFO:teuthology.orchestra.run.smithi142.stderr:Export successful 2024-04-26T02:25:18.547 INFO:tasks.ceph.osd.6.smithi142.stderr:2024-04-26T02:25:18.542+0000 7f2e9e595640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25081) UID: 0 2024-04-26T02:25:18.577 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:18.577 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:18.577 INFO:teuthology.orchestra.run.smithi136.stdout: "num_ops": 0 2024-04-26T02:25:18.577 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:18.582 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:25:18.583 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'unique_pool_0' removed 2024-04-26T02:25:18.594 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_blocked_ops 2024-04-26T02:25:18.617 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T02:25:18.628 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T02:25:18.715 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:18.715 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [], 2024-04-26T02:25:18.715 INFO:teuthology.orchestra.run.smithi136.stdout: "complaint_time": 30, 2024-04-26T02:25:18.716 INFO:teuthology.orchestra.run.smithi136.stdout: "num_blocked_ops": 0 2024-04-26T02:25:18.716 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:18.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.13.asok dump_historic_ops 2024-04-26T02:25:18.857 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-04-26T02:25:18.857 INFO:teuthology.orchestra.run.smithi136.stdout: "size": 20, 2024-04-26T02:25:18.857 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, 2024-04-26T02:25:18.857 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ 2024-04-26T02:25:18.857 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:203 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 72.820674679999996, 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017435761000000001, 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 203 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.858 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033115+0000", 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033119+0000", 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1899999999999997e-06 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.859 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033136+0000", 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7200000000000001e-05 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033176+0000", 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9603e-05 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033196+0000", 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0492999999999998e-05 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.860 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033371+0000", 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000174864 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033394+0000", 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043073+0000", 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0096797610000000003 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.861 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.043333+0000", 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000259602 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.050550+0000", 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0072173649999999999 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.862 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:204 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 72.820544057999996, 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019331481000000001, 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 204 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:25:18.863 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033245+0000", 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033247+0000", 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0870000000000001e-06 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033257+0000", 2024-04-26T02:25:18.864 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.8859999999999999e-06 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033277+0000", 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0213000000000001e-05 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033292+0000", 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4503e-05 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033585+0000", 2024-04-26T02:25:18.865 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00029350600000000002 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033603+0000", 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7706999999999998e-05 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.866 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044154+0000", 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.010550888 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.044306+0000", 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000152258 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.052577+0000", 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0082704330000000006 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.867 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:205 3.9s0 3:998d036b:::smithi17529564-5:head [read 0~81920,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 72.820467035999997, 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020334097999999998, 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 205 2024-04-26T02:25:18.868 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033322+0000", 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033324+0000", 2024-04-26T02:25:18.869 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.297e-06 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033333+0000", 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.2730000000000008e-06 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033352+0000", 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.8768999999999999e-05 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.870 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033369+0000", 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7703999999999999e-05 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033691+0000", 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00032162500000000003 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.033707+0000", 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.6135999999999999e-05 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.871 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.047742+0000", 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014034835000000001 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.048005+0000", 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026275300000000001 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:06.053656+0000", 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0056517060000000003 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 66/31 ECSubWrite(tid=146, reqid=osd.12.0:146, at_version=66'52, trim_to=0'0, roll_forward_to=59'48))", 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 45.383411133000003, 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019654082999999999, 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470378+0000", 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470380+0000", 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5370000000000001e-06 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470428+0000", 2024-04-26T02:25:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.8084999999999998e-05 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470454+0000", 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6611999999999999e-05 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.470474+0000", 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9969000000000001e-05 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472365+0000", 2024-04-26T02:25:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001890978 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.472393+0000", 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7518999999999999e-05 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.489955+0000", 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017561729000000002 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.490032+0000", 2024-04-26T02:25:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.7653999999999999e-05 2024-04-26T02:25:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 66/31 ECSubWrite(tid=202, reqid=osd.0.0:202, at_version=66'52, trim_to=0'0, roll_forward_to=62'48))", 2024-04-26T02:25:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 45.378188256999998, 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.021524287, 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475601+0000", 2024-04-26T02:25:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475603+0000", 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0260000000000002e-06 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475695+0000", 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.1749999999999994e-05 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475731+0000", 2024-04-26T02:25:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6205000000000003e-05 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.475753+0000", 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1903e-05 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483278+0000", 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0075251349999999996 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.483299+0000", 2024-04-26T02:25:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0865000000000001e-05 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497045+0000", 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.013746466000000001 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:33.497125+0000", 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.9937000000000004e-05 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:568 3.9s0 3:998d036b:::smithi17529564-5:head [create,setxattr QRSjfcoZhRVnicS[eSPbUc^qrRbNaYScYbZhaamS (1543) in=40b,setxattr Zjrh`qflgPeZldqmsbbVQnalaXbP[b^fsSploSoT (1295) in=40b,setxattr jP`iT\\QlgssrW_ioUenT[sqaW_soZloqTY`i[fdt (1614) in=40b,setxattr SRRc_re`acb]l\\hiakiqT`Z[isftYagZgp^jjTpO (631) in=40b,setxattr ^RSUl^WUXfaRQU]UYNkYZPilQtYXObeOajNUp`^g (1330) in=40b,setxattr othroUQfhqiX`QOWcQN[mahld[dpocs]\\NNqRSbs (1330) in=40b,setxattr o_ngaOZpXtWoqkaf\\gtRU`]eibg]NedssXjSdVio (631) in=40b,setxattr ^^[OYTcRcbV^X^YZXUd[aUhcdnNYtNgXUfqnaaVR (12980) in=40b,setxattr ekmQRY`lpYsdsPOhhcWUrfrfd]gg\\Y\\VdoSSalnV (70) in=40b,setxattr [ie^NP]erYsq`p_Z]sbfVXSXVnQb^Yr\\dZOjXbad (1543) in=40b,setxattr Z]bNbNRemgjYjpNXZ_mPURYPQNOOWQmmtiVqaUca (630) in=40b,setxattr [jVY`Wq[rUN`kr[k`eq^fOUOSk (9612) in=26b,setxattr ni^VZ^jfqWaQcdQTXiWksqd]_apYpa]g\\kPdhPna (419) in=40b,setxattr _tchprYSfT_SpoXkYcVnYriaVUaom\\t_oaRn[PRT (16348) in=40b,setxattr iSNpZnkoptgrQh_Q[dZah\\WlbjqcP\\aO\\\\Ri]Qeh (10804) in=40b,setxattr q\\WNZWjtm_cR``UmY[sWXRemrptfWmf_SZrOgSYY (7228) in=40b,setxattr UoQsk_NkliWsPpkcptQf\\hclfhVnfNjc]qmkkRaO (102) in=40b,setxattr kkhT]jar]PlaVo]lp (9612) in=17b,setxattr cpPdqsOmpSSPOQWQpgi\\\\cmoRWlSfjYeseZacaOs (698) in=40b,setxattr ssPWdiWi[TVTilZ\\TkcllpdTOZemamorRUtUWY__ (14664) in=40b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.277578359000003, 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022811324000000001, 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 568 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576211+0000", 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576215+0000", 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7139999999999999e-06 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576730+0000", 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000515238 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576792+0000", 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2111000000000002e-05 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576817+0000", 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4579e-05 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.576985+0000", 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000168049 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.577007+0000", 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2143000000000001e-05 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.585039+0000", 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0080317189999999997 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.585473+0000", 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000434597 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589160+0000", 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0036868180000000001 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595161+0000", 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0060015049999999999 2024-04-26T02:25:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.598839+0000", 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00367717 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.599022+0000", 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00018368099999999999 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:574 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~786432] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.267207313999997, 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024397418000000001, 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 574 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586582+0000", 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.586586+0000", 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.76e-06 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588621+0000", 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0020356419999999998 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588663+0000", 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.1369000000000003e-05 2024-04-26T02:25:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.588686+0000", 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2702e-05 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589399+0000", 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00071377599999999995 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.589701+0000", 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000301682 2024-04-26T02:25:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.593275+0000", 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035744739999999998 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.605907+0000", 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.012632012999999999 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.610815+0000", 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0049077330000000001 2024-04-26T02:25:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.610979+0000", 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000164267 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:575 3.es0 3:7bb6d44f:::smithi17529564-19:head [append 0~458752] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.262848515999998, 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.020767264000000001, 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 575 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.895 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590941+0000", 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.590950+0000", 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9870000000000005e-06 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592071+0000", 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001121241 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.896 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592102+0000", 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.1131999999999999e-05 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.592121+0000", 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.914e-05 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.595884+0000", 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0037628990000000001 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.897 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.596158+0000", 2024-04-26T02:25:18.898 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027422500000000001 2024-04-26T02:25:18.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.898 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.898 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.898 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.598383+0000", 2024-04-26T02:25:18.898 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0022244959999999999 2024-04-26T02:25:18.898 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.606145+0000", 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0077616789999999996 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611605+0000", 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054602510000000002 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.611708+0000", 2024-04-26T02:25:18.899 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000103214 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:578 3.es0 3:7bb6d44f:::smithi17529564-19:head [setxattr _header (57) in=7b] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.256642493999998, 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022171715000000002, 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.900 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 578 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597147+0000", 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.901 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597149+0000", 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7269999999999999e-06 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597157+0000", 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7299999999999994e-06 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597177+0000", 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9845999999999999e-05 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.902 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597199+0000", 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1342999999999999e-05 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.614157+0000", 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.016958498999999998 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.903 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.614316+0000", 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015892900000000001 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.615305+0000", 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00098857200000000006 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.617759+0000", 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0024546590000000001 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.904 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619160+0000", 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.001400517 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619319+0000", 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015889300000000001 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:579 3.es0 3:7bb6d44f:::smithi17529564-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:25:18.905 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 41.256570019000002, 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.025841363999999999, 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 579 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597219+0000", 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597221+0000", 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5859999999999999e-06 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597227+0000", 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.2600000000000002e-06 2024-04-26T02:25:18.907 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597248+0000", 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0375999999999999e-05 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.908 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.597263+0000", 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.502e-05 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.616185+0000", 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018922305 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.616447+0000", 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026167300000000003 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.909 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.619961+0000", 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035144899999999999 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.620208+0000", 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00024693300000000002 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:37.623061+0000", 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0028527209999999999 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.910 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:634 3.9s0 3:998264a7:::smithi17529564-45:head [copy-from ver 4] snapc 18=[18,13,11,10] ondisk+write+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.379538390999997, 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024170558000000002, 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 634 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.911 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474251+0000", 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474254+0000", 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.2990000000000001e-06 2024-04-26T02:25:18.912 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474270+0000", 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5486e-05 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474306+0000", 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.6508999999999999e-05 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.913 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474323+0000", 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7096999999999999e-05 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474491+0000", 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00016797599999999999 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474514+0000", 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.2308999999999999e-05 2024-04-26T02:25:18.914 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478081+0000", 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0035677980000000001 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478236+0000", 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00015410900000000001 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.494212+0000", 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.015976898999999999 2024-04-26T02:25:18.915 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496990+0000", 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0027779060000000001 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.498291+0000", 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0013005130000000001 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.498422+0000", 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013065700000000001 2024-04-26T02:25:18.916 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:635 3.9s0 3:998264a7:::smithi17529564-45:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e76)", 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 35.379430814000003, 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.022215378000000001, 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.917 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 635 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474359+0000", 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.918 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474360+0000", 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474366+0000", 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.584e-06 2024-04-26T02:25:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474381+0000", 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.4446e-05 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474389+0000", 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.7560000000000005e-06 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474652+0000", 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026254000000000002 2024-04-26T02:25:18.920 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.474663+0000", 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1382999999999999e-05 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478547+0000", 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0038833000000000001 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.478633+0000", 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6761000000000005e-05 2024-04-26T02:25:18.921 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496261+0000", 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017627779999999999 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496403+0000", 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000141843 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:43.496574+0000", 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000170989 2024-04-26T02:25:18.922 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.as4 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.479293+0000", 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.374495953, 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018478663999999999, 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.923 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479293+0000", 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479293+0000", 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479295+0000", 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9530000000000002e-06 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.479525+0000", 2024-04-26T02:25:18.924 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00022994199999999999 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483009+0000", 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0034832209999999999 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483036+0000", 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.7143000000000001e-05 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.925 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483572+0000", 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00053610500000000005 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.483597+0000", 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.4813000000000001e-05 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.497689+0000", 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014092019000000001 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.926 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.497772+0000", 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.3467999999999994e-05 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "MOSDECSubOpWrite(3.fs1 85/31 ECSubWrite(tid=266, reqid=osd.0.0:266, at_version=85'68, trim_to=0'0, roll_forward_to=84'66))", 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:52.487685+0000", 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 26.366104004, 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.019861462, 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.927 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "reached pg", 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487685+0000", 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487685+0000", 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.928 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487686+0000", 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.6700000000000003e-07 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487738+0000", 2024-04-26T02:25:18.929 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.2159e-05 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487765+0000", 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6806000000000001e-05 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.487787+0000", 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1976000000000001e-05 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.930 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488482+0000", 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00069517899999999998 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.488511+0000", 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.8546000000000001e-05 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.507484+0000", 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018973016999999998 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.931 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:52.507547+0000", 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.3112000000000002e-05 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:790 3.es0 3:7bb6d44f:::smithi17529564-19:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 19.154873765000001, 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017333788999999999, 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.932 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 790 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.933 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698916+0000", 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6700000000000002e-07 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698920+0000", 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.0400000000000003e-06 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698932+0000", 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.131e-05 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.934 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.698939+0000", 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.6690000000000006e-06 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.713695+0000", 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.014755897 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.713972+0000", 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00027666499999999999 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.935 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:24:59.716249+0000", 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.002277341 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:831 3.9s0 3:998d036b:::smithi17529564-5:head [copy-from ver 4] snapc 24=[24,23,22,21,1f,1d,19,10] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:03.485905+0000", 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 15.367883893, 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.027351522999999999, 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.936 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 831 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485905+0000", 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485905+0000", 2024-04-26T02:25:18.937 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485907+0000", 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.0090000000000002e-06 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485915+0000", 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.374e-06 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485930+0000", 2024-04-26T02:25:18.938 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.49e-05 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485940+0000", 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0114e-05 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486019+0000", 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.8961000000000005e-05 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.939 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.940 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op must wait for map", 2024-04-26T02:25:18.940 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486026+0000", 2024-04-26T02:25:18.940 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5129999999999999e-06 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.490795+0000", 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0047686120000000002 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.491072+0000", 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000276648 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.941 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.508168+0000", 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.017096064000000001 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.512801+0000", 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0046331690000000003 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.513109+0000", 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00030839499999999999 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.942 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.513257+0000", 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014776399999999999 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:832 3.9s0 3:998d036b:::smithi17529564-5:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e96)", 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:03.485960+0000", 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 15.367829287999999, 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.024708424, 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.943 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 832 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485960+0000", 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.944 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485960+0000", 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485961+0000", 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.44e-07 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485964+0000", 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.7699999999999999e-06 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.945 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485975+0000", 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0703000000000001e-05 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.485989+0000", 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.416e-05 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486128+0000", 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00013835400000000001 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.946 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.486147+0000", 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.9406999999999999e-05 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.491572+0000", 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0054251899999999999 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.491701+0000", 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000128391 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.947 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.510485+0000", 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018784729999999999 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.510572+0000", 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.6562000000000002e-05 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:03.510668+0000", 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.6513000000000002e-05 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.948 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:858 3.9s0 3:95f223f9:::smithi17529564-27:head [copy-from ver 92] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:08.607183+0000", 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.246606795, 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.045879470999999998, 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 858 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.949 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607183+0000", 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607183+0000", 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607186+0000", 2024-04-26T02:25:18.950 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.0759999999999999e-06 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607201+0000", 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5603e-05 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607257+0000", 2024-04-26T02:25:18.951 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.5312999999999997e-05 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607278+0000", 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1362999999999999e-05 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607420+0000", 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00014232099999999999 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607594+0000", 2024-04-26T02:25:18.952 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017332 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_started", 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.639320+0000", 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.031726524999999998 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_committed", 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.648481+0000", 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0091609819999999998 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.652793+0000", 2024-04-26T02:25:18.953 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.0043116389999999999 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.653062+0000", 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00026932900000000001 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4589.0:859 3.9s0 3:95f223f9:::smithi17529564-27:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:08.607321+0000", 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 10.246468231, 2024-04-26T02:25:18.954 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.039043532999999998, 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4589", 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 859 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607321+0000", 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.955 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607321+0000", 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607323+0000", 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5799999999999999e-06 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607330+0000", 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 7.5630000000000003e-06 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.956 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607368+0000", 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.8099999999999998e-05 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607385+0000", 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7096e-05 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.607938+0000", 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00055258499999999997 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.957 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.608028+0000", 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 9.0078000000000001e-05 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.646024+0000", 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.037996259999999997 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.646188+0000", 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000163437 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.958 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:08.646365+0000", 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00017683400000000001 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(osd.15.22:1 3.es0 3:7bb6d44f:::smithi17529564-19:head [assert-version v81,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102)", 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2024-04-26T02:25:09.537654+0000", 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 9.3161350580000004, 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018952980000000001, 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "continuous": false, 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2024-04-26T02:25:18.959 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "started", 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.537654+0000", 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.537654+0000", 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.537657+0000", 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6070000000000002e-06 2024-04-26T02:25:18.960 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.537669+0000", 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1936999999999999e-05 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", 2024-04-26T02:25:18.961 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.537690+0000", 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.1466000000000001e-05 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.537708+0000", 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.7689999999999998e-05 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.537825+0000", 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000117168 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2024-04-26T02:25:18.962 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.538138+0000", 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.00031243900000000002 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: { 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2024-04-26T02:25:09.556607+0000", 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.018469672999999999 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.963 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.964 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.964 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-04-26T02:25:18.964 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-04-26T02:25:18.964 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-04-26T02:25:18.965 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T02:25:19.084 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-14 --journal-path /var/lib/ceph/osd/ceph-14/journal --force --op remove --pgid 2.3 2024-04-26T02:25:19.096 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:19.096 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:19.097 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:19.097 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:19.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T02:25:19.273 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:19.274 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:19.274 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:19.274 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:19.274 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:19.288 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T02:25:19.415 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=25, reqid=osd.8.0:25, at_version=37'18, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.379294088999998, 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075357569999999997, 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.416 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033384+0000", 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033385+0000", 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4e-07 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.417 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033444+0000", 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.9450999999999997e-05 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033476+0000", 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1979e-05 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.418 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033497+0000", 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0616999999999999e-05 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033684+0000", 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018750700000000001 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.033709+0000", 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4912000000000001e-05 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.419 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040833+0000", 2024-04-26T02:25:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0071240510000000002 2024-04-26T02:25:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.040919+0000", 2024-04-26T02:25:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.6399999999999999e-05 2024-04-26T02:25:19.420 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.378395388000001, 2024-04-26T02:25:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010955845000000001, 2024-04-26T02:25:19.422 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.423 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034282+0000", 2024-04-26T02:25:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.424 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034285+0000", 2024-04-26T02:25:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8669999999999998e-06 2024-04-26T02:25:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034349+0000", 2024-04-26T02:25:19.425 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4090999999999993e-05 2024-04-26T02:25:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034386+0000", 2024-04-26T02:25:19.426 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.6511999999999999e-05 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.034409+0000", 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3198999999999999e-05 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.427 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035470+0000", 2024-04-26T02:25:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001061195 2024-04-26T02:25:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.428 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.035486+0000", 2024-04-26T02:25:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5699999999999999e-05 2024-04-26T02:25:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045121+0000", 2024-04-26T02:25:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096354679999999995 2024-04-26T02:25:19.429 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.045238+0000", 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011681299999999999 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.374003407999993, 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077721719999999999, 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.431 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.432 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038674+0000", 2024-04-26T02:25:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038675+0000", 2024-04-26T02:25:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:19.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038732+0000", 2024-04-26T02:25:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.7024999999999997e-05 2024-04-26T02:25:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.434 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038765+0000", 2024-04-26T02:25:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2325e-05 2024-04-26T02:25:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.435 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.038789+0000", 2024-04-26T02:25:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4905999999999998e-05 2024-04-26T02:25:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039037+0000", 2024-04-26T02:25:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024744900000000001 2024-04-26T02:25:19.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039062+0000", 2024-04-26T02:25:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4719000000000002e-05 2024-04-26T02:25:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.437 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.438 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046357+0000", 2024-04-26T02:25:19.438 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072952980000000004 2024-04-26T02:25:19.438 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.439 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.439 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.046447+0000", 2024-04-26T02:25:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9690000000000004e-05 2024-04-26T02:25:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 37/31 ECSubWrite(tid=64, reqid=osd.0.0:63, at_version=0'0, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.361462361999997, 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067178699999999999, 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.441 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051215+0000", 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051217+0000", 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0099999999999998e-06 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051246+0000", 2024-04-26T02:25:19.442 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8345999999999999e-05 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051275+0000", 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8921999999999999e-05 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051313+0000", 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7991999999999998e-05 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.443 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051640+0000", 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032731600000000002 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.051665+0000", 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4729e-05 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057825+0000", 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0061603889999999996 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.444 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.057933+0000", 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010816599999999999 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 38/31 ECSubWrite(tid=36, reqid=osd.8.0:36, at_version=38'29, trim_to=0'0, roll_forward_to=37'25))", 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.377529256000003, 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018386527999999999, 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.445 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035149+0000", 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.446 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035150+0000", 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9230000000000001e-06 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035236+0000", 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.5860999999999997e-05 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035280+0000", 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3810999999999998e-05 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.447 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035303+0000", 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3223000000000001e-05 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035450+0000", 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014687200000000001 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.035475+0000", 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4623000000000001e-05 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.448 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053426+0000", 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017950875000000002 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.053535+0000", 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00010933999999999999 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.449 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 38/31 ECSubWrite(tid=68, reqid=osd.0.0:68, at_version=38'14, trim_to=0'0, roll_forward_to=37'12))", 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.370851154999997, 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012671968, 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.450 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041827+0000", 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041874+0000", 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6728999999999999e-05 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.451 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041914+0000", 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0312000000000003e-05 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041939+0000", 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4116000000000001e-05 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042110+0000", 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000171094 2024-04-26T02:25:19.452 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.042135+0000", 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.493e-05 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054408+0000", 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012273386000000001 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054499+0000", 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.0650999999999997e-05 2024-04-26T02:25:19.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 38/31 ECSubWrite(tid=16, reqid=osd.15.0:15, at_version=0'0, trim_to=0'0, roll_forward_to=38'12))", 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 73.366245762999995, 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082587159999999993, 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.454 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046432+0000", 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.455 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046434+0000", 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.193e-06 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046463+0000", 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8493e-05 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046509+0000", 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6078000000000002e-05 2024-04-26T02:25:19.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046565+0000", 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6048999999999998e-05 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046730+0000", 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000165408 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.046747+0000", 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6353000000000001e-05 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.457 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054637+0000", 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078899409999999993 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.054691+0000", 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4200999999999998e-05 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.458 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 59/31 ECSubWrite(tid=69, reqid=osd.15.0:69, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.853694458, 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014202093000000001, 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.459 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558983+0000", 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.558985+0000", 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.807e-06 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559023+0000", 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.7985999999999998e-05 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.460 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559047+0000", 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4032999999999998e-05 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559062+0000", 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5082999999999999e-05 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559703+0000", 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064080699999999997 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.461 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.559728+0000", 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4851999999999999e-05 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573054+0000", 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013325590999999999 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.573185+0000", 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000131934 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.462 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 59/31 ECSubWrite(tid=76, reqid=osd.13.0:76, at_version=59'30, trim_to=0'0, roll_forward_to=58'28))", 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.852160239, 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079052459999999995, 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.464 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560518+0000", 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1999999999999999e-07 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560592+0000", 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4134999999999994e-05 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560624+0000", 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1325999999999998e-05 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.465 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560647+0000", 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560875+0000", 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022790500000000001 2024-04-26T02:25:19.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.560900+0000", 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5420000000000001e-05 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568320+0000", 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0074198320000000003 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568423+0000", 2024-04-26T02:25:19.467 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000102675 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.845027989999998, 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084963339999999995, 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.468 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567650+0000", 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567651+0000", 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:25:19.469 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567703+0000", 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2142000000000003e-05 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567774+0000", 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1445000000000005e-05 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567813+0000", 2024-04-26T02:25:19.470 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9026000000000002e-05 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568266+0000", 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00045321000000000001 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568294+0000", 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.743e-05 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576057+0000", 2024-04-26T02:25:19.471 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0077626329999999997 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576146+0000", 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9648000000000006e-05 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:19.472 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.844805391999998, 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014301641, 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567872+0000", 2024-04-26T02:25:19.473 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567874+0000", 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.19e-06 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567930+0000", 2024-04-26T02:25:19.474 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6505999999999997e-05 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567966+0000", 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.5441999999999997e-05 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.567986+0000", 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0086999999999999e-05 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.475 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569871+0000", 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001885751 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.569896+0000", 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4369e-05 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582080+0000", 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012184133999999999 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.476 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.582174+0000", 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4161999999999997e-05 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 66/31 ECSubWrite(tid=77, reqid=osd.15.0:77, at_version=66'60, trim_to=0'0, roll_forward_to=65'58))", 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 45.941376402000003, 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082262370000000008, 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471301+0000", 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.478 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471302+0000", 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2099999999999998e-07 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471322+0000", 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0667000000000001e-05 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471336+0000", 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.348e-05 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471346+0000", 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6739999999999992e-06 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471519+0000", 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00017380499999999999 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.471534+0000", 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479481+0000", 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079467189999999997 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:33.479528+0000", 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7051000000000001e-05 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=50, reqid=client.4589.0:655, at_version=80'37, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:25:19.481 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.886537914000002, 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093202319999999995, 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526140+0000", 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.526141+0000", 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527110+0000", 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00096976099999999997 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527145+0000", 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4860000000000002e-05 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527170+0000", 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5191999999999999e-05 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527416+0000", 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024589499999999999 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.527442+0000", 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6013e-05 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535371+0000", 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079284000000000004 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.535460+0000", 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9450999999999994e-05 2024-04-26T02:25:19.485 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.0s3 80/31 ECSubWrite(tid=51, reqid=client.4589.0:656, at_version=80'38, trim_to=0'0, roll_forward_to=66'35))", 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 31.881406563999999, 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0070853160000000004, 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531271+0000", 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531274+0000", 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.497e-06 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531789+0000", 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00051518199999999999 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531821+0000", 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2305999999999999e-05 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.531844+0000", 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2342000000000001e-05 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.488 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532644+0000", 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00080051600000000003 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.532671+0000", 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6588999999999999e-05 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538264+0000", 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0055933129999999999 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.489 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:47.538357+0000", 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2571000000000005e-05 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 85/31 ECSubWrite(tid=143, reqid=osd.13.0:143, at_version=85'52, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.922386735, 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010592577000000001, 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490291+0000", 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.491 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490292+0000", 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.8999999999999996e-07 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490349+0000", 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6829000000000001e-05 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490671+0000", 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032284000000000002 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490754+0000", 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.2491999999999996e-05 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490891+0000", 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013744699999999999 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.490917+0000", 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6089e-05 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500787+0000", 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0098697860000000002 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500884+0000", 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.6403999999999994e-05 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 85/31 ECSubWrite(tid=144, reqid=osd.13.0:144, at_version=85'54, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:19.494 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 26.917313644, 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073014530000000003, 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.495 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495364+0000", 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495366+0000", 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1600000000000001e-06 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.495422+0000", 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.6128999999999997e-05 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498136+0000", 2024-04-26T02:25:19.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0027135340000000001 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498169+0000", 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2876000000000002e-05 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498749+0000", 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00058028799999999998 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.498775+0000", 2024-04-26T02:25:19.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6270000000000001e-05 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502568+0000", 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037923409999999999 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.502666+0000", 2024-04-26T02:25:19.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7855000000000004e-05 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.fs4 90/31 ECSubWrite(tid=295, reqid=client.4589.0:741, at_version=90'70, trim_to=0'0, roll_forward_to=85'68))", 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 21.902360808000001, 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079796829999999996, 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510317+0000", 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510318+0000", 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3030000000000001e-06 2024-04-26T02:25:19.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510402+0000", 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3401999999999999e-05 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510440+0000", 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8145999999999997e-05 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510469+0000", 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9212000000000001e-05 2024-04-26T02:25:19.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510747+0000", 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027817899999999998 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.510779+0000", 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2189e-05 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.518251+0000", 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007471648 2024-04-26T02:25:19.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:57.518297+0000", 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5603999999999999e-05 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.503 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.5s3 95/31 ECSubWrite(tid=96, reqid=osd.8.0:96, at_version=95'73, trim_to=0'0, roll_forward_to=92'71))", 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 16.925966441, 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079293969999999995, 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486711+0000", 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486712+0000", 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.3000000000000001e-07 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486765+0000", 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3492000000000002e-05 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486791+0000", 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6077000000000001e-05 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486814+0000", 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2762e-05 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486947+0000", 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013290200000000001 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.486962+0000", 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5102999999999999e-05 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.494547+0000", 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.007584833 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.494641+0000", 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3797999999999999e-05 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s1 101/31 ECSubWrite(tid=177, reqid=client.4589.0:858, at_version=101'68, trim_to=0'0, roll_forward_to=100'66))", 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:08.638933+0000", 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 10.773744332, 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010194929, 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.638933+0000", 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.638933+0000", 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.638934+0000", 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3e-07 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642286+0000", 2024-04-26T02:25:19.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003351307 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642315+0000", 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9522999999999998e-05 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642331+0000", 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5447e-05 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642471+0000", 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014026500000000001 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642491+0000", 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0088000000000001e-05 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.649054+0000", 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.006563564 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.649128+0000", 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4004999999999994e-05 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.6s3 102/95 ECSubWrite(tid=96, reqid=client.4589.0:870, at_version=102'72, trim_to=0'0, roll_forward_to=0'0))", 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:09.603584+0000", 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 9.8090939699999993, 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014601332, 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:19.512 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.603584+0000", 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.603584+0000", 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.603585+0000", 2024-04-26T02:25:19.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7600000000000006e-07 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610305+0000", 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0067199080000000001 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610333+0000", 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8459999999999999e-05 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610350+0000", 2024-04-26T02:25:19.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7163000000000002e-05 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610463+0000", 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000112345 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.610478+0000", 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.556e-05 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.618105+0000", 2024-04-26T02:25:19.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076268179999999996 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:09.618185+0000", 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0102e-05 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.516 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:19.518 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-26T02:25:19.639 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:19.640 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:19.640 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:19.640 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:19.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-26T02:25:19.777 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:19.778 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:19.778 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:19.778 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:19.778 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:19.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-26T02:25:19.913 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:19.914 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:19.914 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:19.914 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:19.914 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.914 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.990446962999997, 2024-04-26T02:25:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.073984011000000002, 2024-04-26T02:25:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.915 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.916 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.916 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.916 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.916 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 1 2024-04-26T02:25:19.916 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.916 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.917 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.917 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:19.917 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.917 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.918 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918603+0000", 2024-04-26T02:25:19.918 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.918 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918606+0000", 2024-04-26T02:25:19.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.396e-06 2024-04-26T02:25:19.919 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.919 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.919 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.919 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918620+0000", 2024-04-26T02:25:19.919 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.452e-05 2024-04-26T02:25:19.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.920 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.920 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.920 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918641+0000", 2024-04-26T02:25:19.920 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0389000000000001e-05 2024-04-26T02:25:19.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.921 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.921 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918657+0000", 2024-04-26T02:25:19.921 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6671999999999999e-05 2024-04-26T02:25:19.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.921 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.922 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918805+0000", 2024-04-26T02:25:19.922 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014724900000000001 2024-04-26T02:25:19.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.922 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for peered", 2024-04-26T02:25:19.923 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.918819+0000", 2024-04-26T02:25:19.923 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4453e-05 2024-04-26T02:25:19.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.923 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.923 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.924 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.988816+0000", 2024-04-26T02:25:19.924 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.069997045999999993 2024-04-26T02:25:19.924 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.924 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.924 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989070+0000", 2024-04-26T02:25:19.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00025383399999999998 2024-04-26T02:25:19.925 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.925 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.925 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.925 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.989371+0000", 2024-04-26T02:25:19.925 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00030080500000000002 2024-04-26T02:25:19.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.926 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.926 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.926 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.990597+0000", 2024-04-26T02:25:19.926 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012262740000000001 2024-04-26T02:25:19.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.927 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.927 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.927 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992421+0000", 2024-04-26T02:25:19.927 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001824132 2024-04-26T02:25:19.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.928 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.928 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992517+0000", 2024-04-26T02:25:19.928 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5880999999999999e-05 2024-04-26T02:25:19.928 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.928 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.929 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.929 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:47.992587+0000", 2024-04-26T02:25:19.929 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0359999999999997e-05 2024-04-26T02:25:19.929 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.929 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.929 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.930 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.930 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.930 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:19.930 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.753729557, 2024-04-26T02:25:19.930 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017505889, 2024-04-26T02:25:19.931 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.931 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.931 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.931 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.931 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.931 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.932 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 88 2024-04-26T02:25:19.932 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.932 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.932 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.932 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.932 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:19.933 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.933 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.934 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155321+0000", 2024-04-26T02:25:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155322+0000", 2024-04-26T02:25:19.935 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8000000000000005e-07 2024-04-26T02:25:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155328+0000", 2024-04-26T02:25:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2700000000000001e-06 2024-04-26T02:25:19.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155358+0000", 2024-04-26T02:25:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0624999999999999e-05 2024-04-26T02:25:19.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.938 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.938 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.155373+0000", 2024-04-26T02:25:19.938 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4229999999999999e-05 2024-04-26T02:25:19.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.938 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.939 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.162973+0000", 2024-04-26T02:25:19.939 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0076001050000000002 2024-04-26T02:25:19.939 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.939 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.939 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163128+0000", 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015489200000000001 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.163377+0000", 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024957100000000003 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.940 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.165420+0000", 2024-04-26T02:25:19.941 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0020422349999999999 2024-04-26T02:25:19.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.941 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.941 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.941 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172717+0000", 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0072976839999999996 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172781+0000", 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3910000000000003e-05 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.942 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.172827+0000", 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.5587000000000002e-05 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.943 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.582343461999997, 2024-04-26T02:25:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018318649999999999, 2024-04-26T02:25:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 114 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.945 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326707+0000", 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326708+0000", 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9700000000000005e-07 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326713+0000", 2024-04-26T02:25:19.946 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4530000000000001e-06 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326722+0000", 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9199999999999993e-06 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326729+0000", 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1489999999999997e-06 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.947 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.339956+0000", 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013227153 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340087+0000", 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130946 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.948 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.340294+0000", 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000206434 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344052+0000", 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037581490000000001 2024-04-26T02:25:19.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344900+0000", 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00084779500000000004 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.950 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344967+0000", 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.7607000000000005e-05 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345026+0000", 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8146999999999997e-05 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.951 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.582310579999998, 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019222108000000002, 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.952 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 115 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.953 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.954 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326740+0000", 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.0399999999999995e-07 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326874+0000", 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013342599999999999 2024-04-26T02:25:19.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326885+0000", 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1323e-05 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326893+0000", 2024-04-26T02:25:19.956 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7659999999999998e-06 2024-04-26T02:25:19.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.957 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.957 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.957 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342112+0000", 2024-04-26T02:25:19.957 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015218537000000001 2024-04-26T02:25:19.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.958 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.958 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.958 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342342+0000", 2024-04-26T02:25:19.958 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023057199999999999 2024-04-26T02:25:19.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.342691+0000", 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00034918900000000002 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345831+0000", 2024-04-26T02:25:19.959 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0031394740000000002 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345848+0000", 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7686e-05 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.960 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345912+0000", 2024-04-26T02:25:19.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3709999999999998e-05 2024-04-26T02:25:19.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.961 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.961 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.961 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345962+0000", 2024-04-26T02:25:19.961 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9721e-05 2024-04-26T02:25:19.961 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.582139909000006, 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019714167000000001, 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.962 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 116 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326910+0000", 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326911+0000", 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.8700000000000005e-07 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326924+0000", 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2743e-05 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326934+0000", 2024-04-26T02:25:19.964 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.5459999999999997e-06 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326941+0000", 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1470000000000004e-06 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344124+0000", 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.017183085000000001 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344238+0000", 2024-04-26T02:25:19.965 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000114591 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.344425+0000", 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018710800000000001 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345974+0000", 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001548979 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.966 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346498+0000", 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00052335399999999996 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346570+0000", 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1983000000000005e-05 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346625+0000", 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4843999999999999e-05 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.967 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.582097916999999, 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.020133699000000001, 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.968 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 117 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326952+0000", 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.969 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326953+0000", 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326959+0000", 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.823e-06 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.970 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326968+0000", 2024-04-26T02:25:19.971 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.9530000000000005e-06 2024-04-26T02:25:19.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.971 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.971 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.971 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.326979+0000", 2024-04-26T02:25:19.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1289e-05 2024-04-26T02:25:19.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.972 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.972 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.972 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345091+0000", 2024-04-26T02:25:19.972 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018111505999999999 2024-04-26T02:25:19.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.973 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.973 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345217+0000", 2024-04-26T02:25:19.973 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012587399999999999 2024-04-26T02:25:19.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.345409+0000", 2024-04-26T02:25:19.974 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019226700000000001 2024-04-26T02:25:19.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.974 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.974 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.974 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346352+0000", 2024-04-26T02:25:19.975 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00094280000000000004 2024-04-26T02:25:19.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.975 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.346964+0000", 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00061192899999999999 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347036+0000", 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.2120999999999996e-05 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.977 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.347086+0000", 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0377000000000002e-05 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:19.978 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.417373229999995, 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018319485, 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 139 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.979 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491677+0000", 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491678+0000", 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.333e-06 2024-04-26T02:25:19.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491688+0000", 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.9299999999999998e-06 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491707+0000", 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8281999999999999e-05 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491720+0000", 2024-04-26T02:25:19.981 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3502e-05 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.504966+0000", 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013245808 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505190+0000", 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000223876 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.505520+0000", 2024-04-26T02:25:19.982 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032999 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508527+0000", 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0030072739999999999 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509751+0000", 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0012241719999999999 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.983 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509880+0000", 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128687 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509997+0000", 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000116631 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.985 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.985 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.985 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.985 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:19.985 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.417310053999998, 2024-04-26T02:25:19.985 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018559454, 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 140 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491740+0000", 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491742+0000", 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.404e-06 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491946+0000", 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204086 2024-04-26T02:25:19.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491967+0000", 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1049000000000001e-05 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.988 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.491983+0000", 2024-04-26T02:25:19.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6356000000000001e-05 2024-04-26T02:25:19.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.989 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.989 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.989 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507052+0000", 2024-04-26T02:25:19.989 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015069173 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507208+0000", 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000155783 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.507411+0000", 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020306 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510024+0000", 2024-04-26T02:25:19.990 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026129 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510123+0000", 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.8667999999999998e-05 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510230+0000", 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000107565 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510300+0000", 2024-04-26T02:25:19.991 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.9410000000000001e-05 2024-04-26T02:25:19.992 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.993 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:19.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:19.993 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.993 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.993 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.417039029999998, 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018767703, 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:19.994 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 141 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492011+0000", 2024-04-26T02:25:19.995 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492013+0000", 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4899999999999999e-06 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492039+0000", 2024-04-26T02:25:19.996 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5952000000000002e-05 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492058+0000", 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9215000000000002e-05 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.492082+0000", 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4379000000000002e-05 2024-04-26T02:25:19.997 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508623+0000", 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016540947 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.508846+0000", 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022293599999999999 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.998 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.509201+0000", 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00035443900000000001 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510580+0000", 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0013797379999999999 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:19.999 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510627+0000", 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.6254000000000001e-05 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510715+0000", 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8215999999999997e-05 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.000 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.510779+0000", 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4136999999999999e-05 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:20.001 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.106187098999996, 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018162602999999999, 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:20.002 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 186 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802863+0000", 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.003 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802865+0000", 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.666e-06 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802876+0000", 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1246e-05 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802898+0000", 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1645999999999999e-05 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.004 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802923+0000", 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5389e-05 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.815977+0000", 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013053301 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816115+0000", 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138553 2024-04-26T02:25:20.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816319+0000", 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000204236 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820746+0000", 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0044270739999999996 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.006 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820868+0000", 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000122127 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820949+0000", 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.0395999999999994e-05 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821026+0000", 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.6969000000000001e-05 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.007 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.106101670000001, 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018225614000000001, 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:20.008 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 187 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802949+0000", 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.009 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802950+0000", 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4100000000000001e-06 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802963+0000", 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3206e-05 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.802982+0000", 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8519e-05 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.010 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803002+0000", 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.0162000000000001e-05 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.816937+0000", 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013934867 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817068+0000", 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000130734 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.011 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.817285+0000", 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000217209 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820849+0000", 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0035643160000000001 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821038+0000", 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000188767 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.012 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821122+0000", 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.4243e-05 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821174+0000", 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2181000000000001e-05 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.013 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.106005448000005, 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018460061999999999, 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 188 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.014 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803045+0000", 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803046+0000", 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.4500000000000001e-06 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.015 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803180+0000", 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00013367300000000001 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803201+0000", 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1399e-05 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803217+0000", 2024-04-26T02:25:20.016 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5556000000000001e-05 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818151+0000", 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.014934374 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818319+0000", 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016765500000000001 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:20.017 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.818541+0000", 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00022229899999999999 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821196+0000", 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002654965 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.018 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821379+0000", 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018284400000000001 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821453+0000", 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3546000000000004e-05 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821505+0000", 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2301e-05 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.019 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4260.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 91.105805562, 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018840794000000001, 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4260", 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.59:0/846558918", 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 189 2024-04-26T02:25:20.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803245+0000", 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803246+0000", 2024-04-26T02:25:20.021 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5200000000000001e-06 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803257+0000", 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0825999999999999e-05 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803275+0000", 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8099999999999999e-05 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.022 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.803288+0000", 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2595999999999999e-05 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819675+0000", 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.016387184999999999 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.819800+0000", 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012490999999999999 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting for subops from 5", 2024-04-26T02:25:20.023 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.820077+0000", 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000277533 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op_commit", 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821271+0000", 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193401 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_commit_rec", 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.821965+0000", 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00069420199999999999 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.024 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822036+0000", 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.1119999999999997e-05 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:23:48.822086+0000", 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9400999999999997e-05 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:327 3.8s0 3:1859e9b5:::smithi17529564-39:head [create,setxattr `sjUtrS\\bejkdS^PZ^UbhfeR]sl^p__anSUR_aom (1578) in=40b,setxattr Xgg (981) in=3b,setxattr jjU_`S[ao\\\\^aUS`bZo^cefhdeaegSZfc]sS[m[k (631) in=40b,setxattr WptVXs^]ZljihqWVjRTTRsYbpoOd[kede^[d^iNS (15648) in=40b,setxattr NUPa_VdcRWiTY (981) in=13b,setxattr oapqrhbaXndiek^ec[NZPnlNjeX^`^^ht`__ll[g (630) in=40b,setxattr hUokalb_dNqZaP[SZdSptRb]ZndqQTkPSdWpXlg_ (1683) in=40b,setxattr SOaUaOtoOmejUfsqfadVc_\\fpWak\\^nknRQfaXOZ (9120) in=40b,setxattr r[RO_Pl (981) in=7b,setxattr OOd^ZXYi[]NO^mlSkQafkPlVaY`UYcd\\bnaQUZjq (1225) in=40b,setxattr mlY]_qqgYNhaYetZtkgQPN^a^VmW[amS`Qbadgjr (137) in=40b,setxattr iVYdjchT[j\\[\\\\Uto`qnjUcXas^PtqZa^VoRktTT (1823) in=40b,setxattr PhV`]ZkggalnUas (981) in=15b,setxattr [TNbUtYOkT`ZatPerOQOlk\\WahmgadNWaeRZ^YT\\ (1121) in=40b,setxattr aRqq]f]b_cobaZ`ZZRaattjja[X``PaT\\l\\^Y[jU (313) in=40b,setxattr qYXjVRWg (981) in=8b,setxattr cm`nfp^lmRcSZUsStaOg_omiONqeTRWUsOjm]png (1227) in=40b,setxattr _jtbmRhQeZe]nY\\TQctPVagWm[isibp]ooW`hq[Z (1367) in=40b,setxattr _Ybhal\\]RPkmpUPPRRb[_[YfQpj[aXsgkfNbeeOZ (946) in=40b,setxattr YeQo_aSrmVSirmpTkkZqfZaaqOtg\\X\\qoRPrjPai (1786) in=40b] snapc 9=[9,6] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:20.025 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 64.423447998, 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019121231999999998, 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 327 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:20.026 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485602+0000", 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485606+0000", 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9339999999999999e-06 2024-04-26T02:25:20.027 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485768+0000", 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000162189 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485811+0000", 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.2292000000000001e-05 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485835+0000", 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4182999999999999e-05 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485963+0000", 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000128157 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:20.029 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.485976+0000", 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2571999999999999e-05 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.490733+0000", 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0047575610000000004 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.030 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.491054+0000", 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00032119599999999999 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.493981+0000", 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002926484 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503531+0000", 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.009550088 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.031 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.503808+0000", 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027720000000000002 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:15.504724+0000", 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00091537599999999997 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.032 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:364 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.44701551, 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.019186933, 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:20.033 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 364 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.034 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462035+0000", 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462038+0000", 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6800000000000002e-06 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.035 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462048+0000", 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.0835999999999999e-05 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462072+0000", 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3693000000000002e-05 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462089+0000", 2024-04-26T02:25:20.036 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6586e-05 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462283+0000", 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000194496 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.037 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:20.038 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462306+0000", 2024-04-26T02:25:20.038 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2476e-05 2024-04-26T02:25:20.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.038 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471461+0000", 2024-04-26T02:25:20.039 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091555809999999994 2024-04-26T02:25:20.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.039 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.039 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.471729+0000", 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026759800000000002 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.481222+0000", 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0094929869999999996 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:365 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.446928905, 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.021296017, 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 365 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.041 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462121+0000", 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462123+0000", 2024-04-26T02:25:20.042 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.39e-06 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462153+0000", 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9685000000000001e-05 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462165+0000", 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2964e-05 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.043 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462181+0000", 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5778999999999999e-05 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462501+0000", 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00031995299999999999 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462521+0000", 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9715999999999999e-05 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.044 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473587+0000", 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01106558 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.473802+0000", 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000215899 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.483417+0000", 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0096150509999999995 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:366 3.8s0 3:1cddb788:::smithi17529564-8:d [read 0~999424,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.446830323999997, 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.022939240999999999, 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 366 2024-04-26T02:25:20.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462220+0000", 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.047 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462221+0000", 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2100000000000001e-06 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462229+0000", 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4560000000000003e-06 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462246+0000", 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.7116e-05 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.048 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462259+0000", 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.3526999999999999e-05 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462633+0000", 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00037355199999999998 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.462652+0000", 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.9165999999999999e-05 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.049 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478081+0000", 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015429238 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.478329+0000", 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024798499999999999 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.050 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.485159+0000", 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0068299909999999997 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:508 3.8s0 3:1cc02c30:::smithi17529564-2:head [append 0~606208] snapc f=[f,d] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 52.436645755000001, 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018229054000000001, 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:20.051 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 508 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.052 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472405+0000", 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.472408+0000", 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0800000000000002e-06 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473853+0000", 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0014451850000000001 2024-04-26T02:25:20.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473888+0000", 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4891999999999997e-05 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.473913+0000", 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5123e-05 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.054 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474093+0000", 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018053700000000001 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "op must wait for map", 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.474110+0000", 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6540000000000001e-05 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479082+0000", 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0049724280000000001 2024-04-26T02:25:20.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.479346+0000", 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00026396500000000001 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.482004+0000", 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026579569999999999 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.489855+0000", 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078503649999999998 2024-04-26T02:25:20.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490489+0000", 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00063439499999999995 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:27.490634+0000", 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000144587 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.057 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:775 3.8s0 3:1859e9b5:::smithi17529564-39:head [copy-from ver 26] snapc 21=[21,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 20.261943000999999, 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018551978, 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.058 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 775 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.059 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647107+0000", 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647110+0000", 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6369999999999999e-06 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.647123+0000", 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.2723e-05 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.060 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648317+0000", 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001193789 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648344+0000", 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7373e-05 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648583+0000", 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000239299 2024-04-26T02:25:20.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.648858+0000", 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00027470199999999999 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.660303+0000", 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01144469 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.062 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.664020+0000", 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0037173039999999998 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "commit_sent", 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.665497+0000", 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.001477351 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:59.665659+0000", 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00016211 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "osd_op(client.4589.0:825 3.8s0 3:1cddb788:::smithi17529564-8:head [read 0~3194880,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e95)", 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 17.318863620999998, 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.018450497999999999, 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "started", 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "client_info": { 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "client": "client.4589", 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "tid": 825 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.064 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590187+0000", 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.065 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590188+0000", 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1299999999999998e-07 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590192+0000", 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.7829999999999998e-06 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.066 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590242+0000", 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9406000000000001e-05 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.590251+0000", 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.38e-06 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.595683+0000", 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0054322459999999999 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.067 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "started", 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.595932+0000", 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00024895599999999999 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:02.608637+0000", 2024-04-26T02:25:20.068 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.012704814 2024-04-26T02:25:20.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.069 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.069 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.069 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:20.072 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_ops_in_flight 2024-04-26T02:25:20.198 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:20.198 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:20.199 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:20.213 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_blocked_ops 2024-04-26T02:25:20.264 INFO:teuthology.orchestra.run.smithi142.stdout: marking collection for removal 2024-04-26T02:25:20.264 INFO:teuthology.orchestra.run.smithi142.stdout:setting '_remove' omap key 2024-04-26T02:25:20.264 INFO:teuthology.orchestra.run.smithi142.stdout:finish_remove_pgs 2.3_head removing 2.3 2024-04-26T02:25:20.265 INFO:teuthology.orchestra.run.smithi142.stdout:Remove successful 2024-04-26T02:25:20.338 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:20.338 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:20.338 INFO:teuthology.orchestra.run.smithi142.stdout: "complaint_time": 30, 2024-04-26T02:25:20.339 INFO:teuthology.orchestra.run.smithi142.stdout: "num_blocked_ops": 0 2024-04-26T02:25:20.339 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:20.352 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.10.asok dump_historic_ops 2024-04-26T02:25:20.478 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "size": 20, 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 600, 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [ 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 37/31 ECSubWrite(tid=30, reqid=osd.13.0:30, at_version=37'12, trim_to=0'0, roll_forward_to=36'10))", 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 75.436164961000003, 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082822989999999999, 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.479 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039354+0000", 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039355+0000", 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3300000000000001e-07 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.480 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039418+0000", 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2694999999999995e-05 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039447+0000", 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9442e-05 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039470+0000", 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3232999999999999e-05 2024-04-26T02:25:20.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039659+0000", 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00018914299999999999 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.039683+0000", 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3915999999999999e-05 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047533+0000", 2024-04-26T02:25:20.482 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0078494710000000002 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:05.047636+0000", 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000103566 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 38/31 ECSubWrite(tid=48, reqid=osd.12.0:48, at_version=38'21, trim_to=0'0, roll_forward_to=37'19))", 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 74.433989409999995, 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011160114, 2024-04-26T02:25:20.483 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.484 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.485 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041530+0000", 2024-04-26T02:25:20.485 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4000000000000002e-07 2024-04-26T02:25:20.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.485 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.485 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041580+0000", 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9351999999999998e-05 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041619+0000", 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.9152000000000001e-05 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041643+0000", 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.421e-05 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.486 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041841+0000", 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000197784 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.041867+0000", 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5939e-05 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.487 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052596+0000", 2024-04-26T02:25:20.491 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.01072906 2024-04-26T02:25:20.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.491 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:06.052690+0000", 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.4077000000000001e-05 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 55/31 ECSubWrite(tid=31, reqid=client.4589.0:422, at_version=55'23, trim_to=0'0, roll_forward_to=48'21))", 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:20.492 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 57.616050438999999, 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083055990000000003, 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.493 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.859469+0000", 2024-04-26T02:25:20.494 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.8700000000000001e-07 2024-04-26T02:25:20.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.495 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.495 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862768+0000", 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.003299438 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862799+0000", 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0465999999999999e-05 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.496 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862815+0000", 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6118999999999999e-05 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862957+0000", 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014188100000000001 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.862972+0000", 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5512999999999999e-05 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.497 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867700+0000", 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00472735 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:22.867774+0000", 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.4444999999999996e-05 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.bs2 59/31 ECSubWrite(tid=31, reqid=osd.7.0:31, at_version=59'21, trim_to=0'0, roll_forward_to=58'19))", 2024-04-26T02:25:20.498 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.914134058000002, 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093447500000000006, 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.499 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561385+0000", 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561386+0000", 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.8999999999999996e-07 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561441+0000", 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5689000000000002e-05 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.500 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561502+0000", 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0788000000000001e-05 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561527+0000", 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4479999999999999e-05 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561735+0000", 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020879899999999999 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.501 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.561760+0000", 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5003000000000001e-05 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570592+0000", 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088311770000000008 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570730+0000", 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000138224 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.502 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=133, reqid=osd.12.0:133, at_version=59'46, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.909464751000002, 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013994609999999999, 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.503 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566054+0000", 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566055+0000", 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.504 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566133+0000", 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7651999999999994e-05 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566166+0000", 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.3189999999999999e-05 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566189+0000", 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3315e-05 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.505 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566604+0000", 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00041534500000000002 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.566631+0000", 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6792999999999999e-05 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.506 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579960+0000", 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013328751 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580049+0000", 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8918000000000005e-05 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.507 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.907391580999999, 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015943736999999999, 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:20.508 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568127+0000", 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568128+0000", 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.3e-07 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568181+0000", 2024-04-26T02:25:20.509 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2899000000000003e-05 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568212+0000", 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0596000000000003e-05 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568238+0000", 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6169999999999998e-05 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.510 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568483+0000", 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000245121 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.568508+0000", 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5593e-05 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.511 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.583979+0000", 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.015470133 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584071+0000", 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.2595000000000004e-05 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 59/31 ECSubWrite(tid=135, reqid=osd.12.0:135, at_version=59'48, trim_to=0'0, roll_forward_to=58'44))", 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.904746815999999, 2024-04-26T02:25:20.512 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013783561999999999, 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570772+0000", 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570774+0000", 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6029999999999999e-06 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570834+0000", 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.0248999999999999e-05 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570863+0000", 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8473e-05 2024-04-26T02:25:20.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.570927+0000", 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4335e-05 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571242+0000", 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000315144 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.571308+0000", 2024-04-26T02:25:20.515 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.5808000000000004e-05 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584459+0000", 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.013150818 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584556+0000", 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7132000000000004e-05 2024-04-26T02:25:20.516 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=18, reqid=osd.14.0:18, at_version=59'16, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.901464717000003, 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011186935, 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.517 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574054+0000", 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.518 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574055+0000", 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.6000000000000003e-07 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574110+0000", 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.4701999999999999e-05 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574134+0000", 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4672999999999999e-05 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.519 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.574153+0000", 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8372999999999998e-05 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576753+0000", 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0026005830000000001 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576778+0000", 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4793000000000001e-05 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585168+0000", 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083896360000000007 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.585241+0000", 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.3515000000000003e-05 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 59/31 ECSubWrite(tid=78, reqid=osd.13.0:76, at_version=0'0, trim_to=0'0, roll_forward_to=59'30))", 2024-04-26T02:25:20.521 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.899772358999996, 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0084735320000000006, 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.522 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575747+0000", 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.523 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575749+0000", 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.8700000000000001e-06 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575775+0000", 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.6783000000000001e-05 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575804+0000", 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8296000000000001e-05 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.524 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.575826+0000", 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1970000000000001e-05 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576058+0000", 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00023252799999999999 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.576084+0000", 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5469e-05 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.525 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584119+0000", 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080353009999999999 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.584220+0000", 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000101315 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 59/31 ECSubWrite(tid=19, reqid=osd.14.0:19, at_version=59'18, trim_to=0'0, roll_forward_to=58'14))", 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 53.896659376000002, 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.010250464000000001, 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.527 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578860+0000", 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.528 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578862+0000", 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.136e-06 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578953+0000", 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.1671999999999999e-05 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.578986+0000", 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2431999999999997e-05 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.529 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.579009+0000", 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2997e-05 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580832+0000", 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0018229279999999999 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.530 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.580857+0000", 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5069999999999999e-05 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589005+0000", 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0081481079999999994 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.531 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:26.589110+0000", 2024-04-26T02:25:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105121 2024-04-26T02:25:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.532 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.1s3 70/31 ECSubWrite(tid=55, reqid=client.4589.0:560, at_version=70'42, trim_to=0'0, roll_forward_to=66'40))", 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.910271139999999, 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093224269999999995, 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565248+0000", 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.534 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565250+0000", 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6199999999999999e-06 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565896+0000", 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00064622300000000002 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.535 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565930+0000", 2024-04-26T02:25:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4175999999999999e-05 2024-04-26T02:25:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.538 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.565946+0000", 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6552999999999999e-05 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566110+0000", 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000163468 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.566143+0000", 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2833000000000002e-05 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.539 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574369+0000", 2024-04-26T02:25:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082260839999999998 2024-04-26T02:25:20.540 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.574570+0000", 2024-04-26T02:25:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00020147000000000001 2024-04-26T02:25:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.542 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 70/31 ECSubWrite(tid=94, reqid=client.4589.0:568, at_version=70'45, trim_to=0'0, roll_forward_to=66'44))", 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 42.885552048000001, 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008202048, 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589967+0000", 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.589975+0000", 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.3129999999999999e-06 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.544 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590472+0000", 2024-04-26T02:25:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00049691600000000002 2024-04-26T02:25:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590505+0000", 2024-04-26T02:25:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2285e-05 2024-04-26T02:25:20.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590526+0000", 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.1923999999999999e-05 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590669+0000", 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014244400000000001 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.590693+0000", 2024-04-26T02:25:20.547 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.4459000000000001e-05 2024-04-26T02:25:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598075+0000", 2024-04-26T02:25:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0073818080000000001 2024-04-26T02:25:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.548 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:37.598169+0000", 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.3899000000000003e-05 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 85/31 ECSubWrite(tid=198, reqid=client.4589.0:707, at_version=85'73, trim_to=0'0, roll_forward_to=82'69))", 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.997434640000002, 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082988119999999992, 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.549 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478084+0000", 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.550 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478086+0000", 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.734e-06 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478493+0000", 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00040724799999999997 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478528+0000", 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4873000000000003e-05 2024-04-26T02:25:20.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478550+0000", 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2056e-05 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478704+0000", 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00015417299999999999 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.478732+0000", 2024-04-26T02:25:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7063000000000002e-05 2024-04-26T02:25:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.553 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486268+0000", 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0075361270000000001 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.486383+0000", 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000115538 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=143, reqid=osd.13.0:143, at_version=85'52, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.987280052999999, 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011977942, 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.555 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488239+0000", 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488240+0000", 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.0999999999999999e-07 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488293+0000", 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3179e-05 2024-04-26T02:25:20.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488325+0000", 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2786000000000001e-05 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488348+0000", 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.2572999999999999e-05 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488541+0000", 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00019315599999999999 2024-04-26T02:25:20.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.488567+0000", 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5746e-05 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500120+0000", 2024-04-26T02:25:20.558 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.011552644000000001 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.500217+0000", 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 9.7348000000000004e-05 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.7s5 85/31 ECSubWrite(tid=45, reqid=osd.3.0:45, at_version=85'42, trim_to=0'0, roll_forward_to=84'38))", 2024-04-26T02:25:20.559 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.983553973999999, 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0093409329999999992, 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491965+0000", 2024-04-26T02:25:20.560 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.491967+0000", 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5400000000000001e-06 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492019+0000", 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.2326e-05 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492059+0000", 2024-04-26T02:25:20.561 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.0499e-05 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492088+0000", 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8883000000000001e-05 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.562 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493095+0000", 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0010064850000000001 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.493119+0000", 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3900000000000002e-05 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501188+0000", 2024-04-26T02:25:20.563 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0080696529999999995 2024-04-26T02:25:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501306+0000", 2024-04-26T02:25:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00011764699999999999 2024-04-26T02:25:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.565 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.8s3 85/31 ECSubWrite(tid=259, reqid=osd.6.0:259, at_version=85'86, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.983406707, 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0091845999999999994, 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.566 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492112+0000", 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492113+0000", 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1399999999999997e-07 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.567 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492162+0000", 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 4.9152e-05 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492192+0000", 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.9983000000000001e-05 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492215+0000", 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3206000000000001e-05 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.568 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492386+0000", 2024-04-26T02:25:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000170466 2024-04-26T02:25:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:25:20.569 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.5225999999999999e-05 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501191+0000", 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0087800949999999999 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.570 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501297+0000", 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000105858 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.2s5 85/31 ECSubWrite(tid=57, reqid=osd.14.0:57, at_version=85'56, trim_to=0'0, roll_forward_to=82'54))", 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.983144132, 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0088827960000000001, 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.571 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492375+0000", 2024-04-26T02:25:20.572 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492376+0000", 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.1600000000000001e-07 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492431+0000", 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.5229000000000003e-05 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492463+0000", 2024-04-26T02:25:20.573 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.2716000000000003e-05 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492487+0000", 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3050000000000001e-05 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492914+0000", 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00042767800000000002 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.574 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.492946+0000", 2024-04-26T02:25:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.1772e-05 2024-04-26T02:25:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501157+0000", 2024-04-26T02:25:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0082111800000000002 2024-04-26T02:25:20.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.501258+0000", 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000100555 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 85/31 ECSubWrite(tid=144, reqid=osd.13.0:144, at_version=85'54, trim_to=0'0, roll_forward_to=84'50))", 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 27.979371307000001, 2024-04-26T02:25:20.577 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083376070000000004, 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496148+0000", 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.578 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496155+0000", 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.5669999999999997e-06 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496209+0000", 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 5.3538999999999997e-05 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.579 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496244+0000", 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.4665000000000001e-05 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496267+0000", 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.3533e-05 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496416+0000", 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014877400000000001 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.580 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.496443+0000", 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.7146000000000001e-05 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504421+0000", 2024-04-26T02:25:20.581 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0079782480000000003 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:24:52.504485+0000", 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.4134999999999995e-05 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.as3 101/31 ECSubWrite(tid=223, reqid=client.4589.0:844, at_version=101'78, trim_to=0'0, roll_forward_to=95'76))", 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:08.558401+0000", 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.917117729999999, 2024-04-26T02:25:20.582 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.008520339, 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.558401+0000", 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.558401+0000", 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.583 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.558402+0000", 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 6.2300000000000001e-07 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.560975+0000", 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0025732789999999999 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561004+0000", 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 2.8317e-05 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561019+0000", 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.5726000000000002e-05 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561166+0000", 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00014697399999999999 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.561182+0000", 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6067e-05 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.585 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.566844+0000", 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0056617179999999996 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.566922+0000", 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 7.7634999999999998e-05 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.586 INFO:teuthology.orchestra.run.smithi142.stdout: "description": "MOSDECSubOpWrite(3.9s2 101/31 ECSubWrite(tid=177, reqid=client.4589.0:858, at_version=101'68, trim_to=0'0, roll_forward_to=100'66))", 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "initiated_at": "2024-04-26T02:25:08.639837+0000", 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "age": 11.835682265999999, 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.0083802570000000003, 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "continuous": false, 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "type_data": { 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "events": [ 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "initiated", 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.639837+0000", 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "header_read", 2024-04-26T02:25:20.587 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.639837+0000", 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "throttled", 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.639838+0000", 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 8.8899999999999998e-07 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "all_read", 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.641956+0000", 2024-04-26T02:25:20.588 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.002118628 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "dispatched", 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.641986+0000", 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 3.0051000000000001e-05 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.641998+0000", 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.1986e-05 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "reached_pg", 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642124+0000", 2024-04-26T02:25:20.589 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.00012521599999999999 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.642140+0000", 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 1.6039999999999999e-05 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.648108+0000", 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.005968859 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: { 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "event": "done", 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "time": "2024-04-26T02:25:08.648217+0000", 2024-04-26T02:25:20.590 INFO:teuthology.orchestra.run.smithi142.stdout: "duration": 0.000108588 2024-04-26T02:25:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: } 2024-04-26T02:25:20.591 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2024-04-26T02:25:20.591 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:20.592 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-26T02:25:20.630 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T02:25:20.723 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:20.723 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:20.723 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:20.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-26T02:25:20.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-12 --journal-path /var/lib/ceph/osd/ceph-12/journal --op list-pgs 2024-04-26T02:25:20.858 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:20.858 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:20.858 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:20.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 37/31 ECSubWrite(tid=26, reqid=osd.8.0:26, at_version=37'20, trim_to=0'0, roll_forward_to=36'16))", 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 75.956028129999993, 2024-04-26T02:25:20.995 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011126728000000001, 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034938+0000", 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:20.996 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034940+0000", 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.663e-06 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.034988+0000", 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.7794999999999999e-05 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.997 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035017+0000", 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9139e-05 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035039+0000", 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2178999999999999e-05 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035616+0000", 2024-04-26T02:25:20.998 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057682000000000002 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.035639+0000", 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2915999999999999e-05 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.045974+0000", 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01033568 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:20.999 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:05.046065+0000", 2024-04-26T02:25:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.0536000000000002e-05 2024-04-26T02:25:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.000 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=132, reqid=osd.12.0:132, at_version=59'50, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.424867132000003, 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012148091999999999, 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.001 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.002 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566099+0000", 2024-04-26T02:25:21.003 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566100+0000", 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5400000000000002e-07 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.004 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566148+0000", 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8294999999999998e-05 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566223+0000", 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5108e-05 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.005 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566249+0000", 2024-04-26T02:25:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6033e-05 2024-04-26T02:25:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566409+0000", 2024-04-26T02:25:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015976299999999999 2024-04-26T02:25:21.006 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566436+0000", 2024-04-26T02:25:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7226e-05 2024-04-26T02:25:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.007 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578152+0000", 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011716358 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578247+0000", 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4854999999999999e-05 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=165, reqid=osd.0.0:165, at_version=59'43, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:21.008 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.424025901999997, 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010768801999999999, 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566940+0000", 2024-04-26T02:25:21.009 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566941+0000", 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8700000000000005e-07 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.566993+0000", 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2308999999999997e-05 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.010 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567025+0000", 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1934999999999998e-05 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567047+0000", 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2024000000000001e-05 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567199+0000", 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000151662 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.011 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567223+0000", 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3717e-05 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577442+0000", 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010219257000000001 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.012 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.577709+0000", 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000267211 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.fs6 59/31 ECSubWrite(tid=166, reqid=osd.0.0:166, at_version=59'45, trim_to=0'0, roll_forward_to=58'41))", 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.423869447999998, 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014918226, 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.013 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567097+0000", 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.014 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567098+0000", 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.463e-06 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567147+0000", 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8551999999999999e-05 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.015 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567169+0000", 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2215999999999999e-05 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.567188+0000", 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8756000000000001e-05 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571613+0000", 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004424936 2024-04-26T02:25:21.016 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9245000000000001e-05 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581898+0000", 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010246251 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.582015+0000", 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011680699999999999 2024-04-26T02:25:21.017 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.420462033, 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013337598000000001, 2024-04-26T02:25:21.018 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570504+0000", 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.019 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570506+0000", 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.844e-06 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.020 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570590+0000", 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3950999999999996e-05 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570623+0000", 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3315999999999997e-05 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.021 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570651+0000", 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7319000000000001e-05 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571614+0000", 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00096303399999999998 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.022 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571652+0000", 2024-04-26T02:25:21.023 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8068999999999998e-05 2024-04-26T02:25:21.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583776+0000", 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012123818999999999 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.025 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583842+0000", 2024-04-26T02:25:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6246000000000002e-05 2024-04-26T02:25:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.026 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.418102359000002, 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011065805, 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572864+0000", 2024-04-26T02:25:21.028 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572865+0000", 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9400000000000004e-07 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572920+0000", 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5031999999999998e-05 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572952+0000", 2024-04-26T02:25:21.029 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1992000000000001e-05 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.572974+0000", 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1829999999999999e-05 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573193+0000", 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021909100000000001 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.030 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.573218+0000", 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5363000000000001e-05 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583849+0000", 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010630472 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583930+0000", 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.1230999999999995e-05 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 66/31 ECSubWrite(tid=204, reqid=osd.0.0:203, at_version=0'0, trim_to=0'0, roll_forward_to=66'106))", 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 47.496709097, 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010850225, 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:21.032 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494257+0000", 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494258+0000", 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1069999999999999e-06 2024-04-26T02:25:21.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494289+0000", 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0175000000000002e-05 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494320+0000", 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1869999999999998e-05 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.034 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.494360+0000", 2024-04-26T02:25:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9952e-05 2024-04-26T02:25:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.035 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496568+0000", 2024-04-26T02:25:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022078480000000001 2024-04-26T02:25:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.038 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.496593+0000", 2024-04-26T02:25:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4641999999999999e-05 2024-04-26T02:25:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505054+0000", 2024-04-26T02:25:21.039 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0084610469999999993 2024-04-26T02:25:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.505107+0000", 2024-04-26T02:25:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3584000000000001e-05 2024-04-26T02:25:21.040 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=77, reqid=osd.11.0:77, at_version=85'63, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:21.041 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.511112545, 2024-04-26T02:25:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012557278, 2024-04-26T02:25:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.042 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479854+0000", 2024-04-26T02:25:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9299999999999997e-07 2024-04-26T02:25:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479907+0000", 2024-04-26T02:25:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.2293999999999998e-05 2024-04-26T02:25:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479938+0000", 2024-04-26T02:25:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0728999999999997e-05 2024-04-26T02:25:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.479960+0000", 2024-04-26T02:25:21.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2682999999999999e-05 2024-04-26T02:25:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480947+0000", 2024-04-26T02:25:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0009871490000000001 2024-04-26T02:25:21.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.480973+0000", 2024-04-26T02:25:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5704999999999999e-05 2024-04-26T02:25:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492318+0000", 2024-04-26T02:25:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0113448 2024-04-26T02:25:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492411+0000", 2024-04-26T02:25:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.3225000000000003e-05 2024-04-26T02:25:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.051 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s1 85/31 ECSubWrite(tid=84, reqid=osd.8.0:84, at_version=85'61, trim_to=0'0, roll_forward_to=83'59))", 2024-04-26T02:25:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.507539291000001, 2024-04-26T02:25:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011418342, 2024-04-26T02:25:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.052 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483427+0000", 2024-04-26T02:25:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483428+0000", 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4600000000000004e-07 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483486+0000", 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8236999999999998e-05 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483515+0000", 2024-04-26T02:25:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9169000000000001e-05 2024-04-26T02:25:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483539+0000", 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4226000000000001e-05 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484639+0000", 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001099952 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484657+0000", 2024-04-26T02:25:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7496999999999999e-05 2024-04-26T02:25:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494743+0000", 2024-04-26T02:25:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010086573 2024-04-26T02:25:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.494845+0000", 2024-04-26T02:25:21.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000102042 2024-04-26T02:25:21.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.060 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.060 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.060 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.1s6 85/31 ECSubWrite(tid=78, reqid=osd.11.0:78, at_version=85'65, trim_to=0'0, roll_forward_to=84'61))", 2024-04-26T02:25:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 28.506449727, 2024-04-26T02:25:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010793934, 2024-04-26T02:25:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.061 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484517+0000", 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484518+0000", 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.22e-06 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484568+0000", 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9798e-05 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.064 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484599+0000", 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1384999999999999e-05 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.484621+0000", 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1818999999999999e-05 2024-04-26T02:25:21.065 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492500+0000", 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007879268 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.492527+0000", 2024-04-26T02:25:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7212e-05 2024-04-26T02:25:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495235+0000", 2024-04-26T02:25:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027078060000000001 2024-04-26T02:25:21.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.495311+0000", 2024-04-26T02:25:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5426000000000006e-05 2024-04-26T02:25:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.068 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 90/31 ECSubWrite(tid=288, reqid=client.4589.0:736, at_version=90'154, trim_to=0'0, roll_forward_to=88'152))", 2024-04-26T02:25:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 23.503673340999999, 2024-04-26T02:25:21.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012431226, 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:21.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487293+0000", 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487294+0000", 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7700000000000004e-07 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487571+0000", 2024-04-26T02:25:21.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027720199999999999 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487600+0000", 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9028999999999999e-05 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487617+0000", 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6878999999999999e-05 2024-04-26T02:25:21.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487802+0000", 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018537999999999999 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.487856+0000", 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.4237000000000003e-05 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499640+0000", 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011783903 2024-04-26T02:25:21.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.499724+0000", 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4018999999999996e-05 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:849 3.7s0 3:ed555be7:::smithi17529564-3:head [create,setxattr clNOgfqtsg\\aUXcbnbsgicte[dlcgscTctZg\\UYb (1261) in=40b,setxattr ^kePZO^jc[`nRrZQr^g`hWUbUbmVa_[^`ndQ_ebi (207) in=40b,setxattr pd\\tReSgkdQqSk_oQZgRskailqSfXkleakRgOpgs (735) in=40b,setxattr `\\Uhenhpc\\oVlscgQb^Wpj]b[jPkrs]S`tY^nfNX (1506) in=40b,setxattr mYhN^Rig]VasbVqh]mfR[[pqUcOYh]_aWp\\m_tls (1891) in=40b,setxattr hie`]lstsZtOilXYaRecaiXtt]gcmm^a[tWjt[YT (311) in=40b,setxattr hkRZhYOPaigVYZmnZe^p`NTbkSNSiVgfgVijksca (455) in=40b,setxattr `sdWbhfe[ng_eOr]YcXa]ahtbPgochac``jdt`hh (1262) in=40b,setxattr aPlreWi_Xm]iktYWh`g_aSaRPrXe]adtOdO]]bsq (347) in=40b,setxattr p_qb[TbOoSb^Z[jcnVcp[Vb_XQ^gddoWiVa^NPYR (385) in=40b,setxattr VgQd`_b]^jekaYilkQoqdami]]mhVp\\fbWfmkbVU (1295) in=40b,setxattr tWfY]UYjtVla^t`]`Z[s\\sp`]jp^jcoVP[kaYTjb (1893) in=40b,setxattr ZeWXgW`YOnsgbbrr`eRYbpbOQeTm_g^hkeqUdl_X (982) in=40b,setxattr aoh__jnjZmcV_Zd[lTjob_PfRoWV (1822) in=28b,setxattr Og\\PgsWdl_jTZ]kbbRXdO`bhQsdfmNUjgURgh\\`^ (1997) in=40b,setxattr fWcmbPRf_fT[s`o`jq^\\U_m_UlTQhjpPfe]Oq^Zs (1645) in=40b,setxattr jQT^\\Zie\\orcqPOr]sg\\\\PWNdY`OYs^QYktWQsTd (1789) in=40b,setxattr N_TeWQ`\\cU]`mQPYod^P]RXe[YaVQncV^sk`_bVn (1785) in=40b,setxattr jQhOSafV (1822) in=8b,setxattr ]daaodicjtV`q_`__etNiom_n`abiaa`sbrXmcaT (947) in=40b] snapc 26=[26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.561881+0000", 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.429085297, 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012640907, 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 849 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561881+0000", 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561881+0000", 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561885+0000", 2024-04-26T02:25:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7500000000000001e-06 2024-04-26T02:25:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561955+0000", 2024-04-26T02:25:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9898000000000001e-05 2024-04-26T02:25:21.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.561993+0000", 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7895999999999998e-05 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.562016+0000", 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3379000000000001e-05 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.564350+0000", 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023341999999999998 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.564802+0000", 2024-04-26T02:25:21.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000452146 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.567916+0000", 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031137389999999999 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.572994+0000", 2024-04-26T02:25:21.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0050781899999999998 2024-04-26T02:25:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.573245+0000", 2024-04-26T02:25:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025114400000000002 2024-04-26T02:25:21.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.574522+0000", 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0012765649999999999 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:861 3.7s0 3:e9c97fb0:::smithi17529564-43:26 [read 0~2949120,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.622793+0000", 2024-04-26T02:25:21.082 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.36817342, 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016005122, 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 861 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.083 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622793+0000", 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622793+0000", 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622796+0000", 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.23e-06 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622812+0000", 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5787e-05 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622853+0000", 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1211999999999998e-05 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622876+0000", 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2901999999999999e-05 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623018+0000", 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014194000000000001 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623509+0000", 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00049130799999999998 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638798+0000", 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015288743 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.086 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:862 3.7s0 3:e9c97fb0:::smithi17529564-43:26 [read 0~2949120,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.622925+0000", 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.3680415, 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021613954000000001, 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 862 2024-04-26T02:25:21.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622925+0000", 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622925+0000", 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622926+0000", 2024-04-26T02:25:21.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5629999999999999e-06 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622938+0000", 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1240000000000001e-05 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622958+0000", 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0426000000000001e-05 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.622982+0000", 2024-04-26T02:25:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3516e-05 2024-04-26T02:25:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.625947+0000", 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029656880000000002 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626282+0000", 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033498700000000002 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.644539+0000", 2024-04-26T02:25:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018256534000000001 2024-04-26T02:25:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:863 3.7s0 3:e9c97fb0:::smithi17529564-43:26 [read 0~2949120,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.623013+0000", 2024-04-26T02:25:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.367953193, 2024-04-26T02:25:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.026093545999999999, 2024-04-26T02:25:21.093 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 863 2024-04-26T02:25:21.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.095 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623013+0000", 2024-04-26T02:25:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623013+0000", 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623014+0000", 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.217e-06 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623022+0000", 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8429999999999993e-06 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623041+0000", 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8573e-05 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.623054+0000", 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3269e-05 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.629657+0000", 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0066030500000000001 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.629784+0000", 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00012652400000000001 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.649107+0000", 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019323070000000001 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.105 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds6 101/31 ECSubWrite(tid=225, reqid=client.4589.0:864, at_version=101'112, trim_to=0'0, roll_forward_to=100'110))", 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.626538+0000", 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.364428344, 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012379775000000001, 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626538+0000", 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626538+0000", 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626539+0000", 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.4600000000000004e-07 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626596+0000", 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7404999999999997e-05 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626619+0000", 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3286e-05 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626640+0000", 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0333e-05 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626743+0000", 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000103646 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.626755+0000", 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1712999999999999e-05 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638845+0000", 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012089501000000001 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638918+0000", 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3145000000000005e-05 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.109 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 101/31 ECSubWrite(tid=362, reqid=client.4589.0:867, at_version=101'209, trim_to=0'0, roll_forward_to=101'207))", 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.630898+0000", 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.360068728, 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017385771000000001, 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.630898+0000", 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.630898+0000", 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.630899+0000", 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3239999999999999e-06 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631118+0000", 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021913 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631148+0000", 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9856e-05 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631171+0000", 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2901999999999999e-05 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631370+0000", 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019881400000000001 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.631394+0000", 2024-04-26T02:25:21.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4465999999999999e-05 2024-04-26T02:25:21.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.648175+0000", 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016781292 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.648283+0000", 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010798699999999999 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.7s0 101/95 ECSubReadReply(tid=54, attrs_read=0))", 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.637871+0000", 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.353094844999999, 2024-04-26T02:25:21.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011349812000000001, 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637871+0000", 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637871+0000", 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637873+0000", 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.184e-06 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.640161+0000", 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022883320000000001 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.640190+0000", 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8619000000000002e-05 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.640208+0000", 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8229000000000001e-05 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.645328+0000", 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051196920000000003 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.649221+0000", 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003893756 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.118 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs5 101/31 ECSubWrite(tid=363, reqid=client.4589.0:856, at_version=101'211, trim_to=0'0, roll_forward_to=101'207))", 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.639048+0000", 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.351918648, 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012281583, 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.639048+0000", 2024-04-26T02:25:21.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.639048+0000", 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.639049+0000", 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.708e-06 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642102+0000", 2024-04-26T02:25:21.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0030523579999999998 2024-04-26T02:25:21.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642261+0000", 2024-04-26T02:25:21.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000159233 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642285+0000", 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3767000000000001e-05 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642601+0000", 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031657700000000002 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.642630+0000", 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8572999999999999e-05 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.651227+0000", 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085968069999999997 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.651329+0000", 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010255999999999999 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:900 3.7s0 3:e9c97fb0:::smithi17529564-43:head [delete] snapc 29=[29,28,27,26,23,22,21,19,10] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e105)", 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:12.588200+0000", 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 8.4027662739999993, 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011191424, 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.124 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 900 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588200+0000", 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588200+0000", 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588202+0000", 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1320000000000001e-06 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588210+0000", 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7559999999999999e-06 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588229+0000", 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9327e-05 2024-04-26T02:25:21.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588266+0000", 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6275000000000001e-05 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588399+0000", 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013349600000000001 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588625+0000", 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022554500000000001 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.590084+0000", 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014594930000000001 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.594944+0000", 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048599130000000004 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.598749+0000", 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003804998 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.599391+0000", 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00064248899999999999 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.129 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:21.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-26T02:25:21.260 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:21.260 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:21.260 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:21.260 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:21.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-26T02:25:21.397 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:21.397 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:21.397 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:21.397 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:21.397 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:21.412 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-26T02:25:21.537 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:21.537 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:21.537 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:406 3.bs0 3:d145576f:::smithi17529564-17:head [append 0~475136] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 58.739140128999999, 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010860336999999999, 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.538 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 406 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794004+0000", 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.539 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794007+0000", 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4770000000000002e-06 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794660+0000", 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00065313299999999997 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794694+0000", 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4014999999999999e-05 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.540 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.794716+0000", 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2846000000000001e-05 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795033+0000", 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000316965 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795302+0000", 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000268853 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.541 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.797207+0000", 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0019045690000000001 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.803798+0000", 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006591281 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804729+0000", 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00093087200000000001 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.542 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.804864+0000", 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013532600000000001 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:409 3.bs0 3:d145576f:::smithi17529564-17:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 58.737155665000003, 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013475743, 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.543 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 409 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795988+0000", 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795990+0000", 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.42e-06 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.795995+0000", 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5799999999999999e-06 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796017+0000", 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1778999999999999e-05 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.796033+0000", 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6022999999999999e-05 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806706+0000", 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010672472000000001 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.547 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.806946+0000", 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024007 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.809464+0000", 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0025183990000000002 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:413 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~131072] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:25:21.548 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 58.719338157999999, 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011855436, 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 413 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813806+0000", 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813808+0000", 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0200000000000001e-06 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813887+0000", 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9437999999999994e-05 2024-04-26T02:25:21.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813913+0000", 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5082000000000001e-05 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813931+0000", 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.859e-05 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818168+0000", 2024-04-26T02:25:21.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0042373460000000003 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.818314+0000", 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000145289 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.552 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819109+0000", 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079474400000000001 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825348+0000", 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062396159999999999 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825501+0000", 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152583 2024-04-26T02:25:21.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.825661+0000", 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016072800000000001 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:414 3.bs0 3:db601e58:::smithi17529564-10:head [setxattr _header (57) in=7b] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 58.719181785000004, 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012515695, 2024-04-26T02:25:21.554 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 414 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813962+0000", 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813964+0000", 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.59e-06 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813973+0000", 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6689999999999995e-06 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.813993+0000", 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0440000000000001e-05 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814007+0000", 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4073000000000001e-05 2024-04-26T02:25:21.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.819880+0000", 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058725599999999998 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820055+0000", 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017564800000000001 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.820866+0000", 2024-04-26T02:25:21.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000810299 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826013+0000", 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051474570000000002 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826385+0000", 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00037209199999999997 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826478+0000", 2024-04-26T02:25:21.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2867000000000004e-05 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:415 3.bs0 3:db601e58:::smithi17529564-10:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 58.719117351000001, 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014775608000000001, 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 415 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814027+0000", 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814028+0000", 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2270000000000001e-06 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814034+0000", 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6230000000000002e-06 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814070+0000", 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6513000000000001e-05 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.814083+0000", 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.332e-05 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821842+0000", 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0077589859999999998 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.821934+0000", 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1736000000000004e-05 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826791+0000", 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0048572470000000003 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.826870+0000", 2024-04-26T02:25:21.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8065999999999994e-05 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.828802+0000", 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00193289 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=201, reqid=osd.6.0:201, at_version=59'29, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.964996861000003, 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01558203, 2024-04-26T02:25:21.565 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568147+0000", 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568148+0000", 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5300000000000004e-07 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568196+0000", 2024-04-26T02:25:21.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.8158999999999997e-05 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568232+0000", 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5565999999999998e-05 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568269+0000", 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7141999999999998e-05 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.568 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568551+0000", 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028192700000000001 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.568576+0000", 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5171999999999999e-05 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583637+0000", 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015060841 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583729+0000", 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2570000000000003e-05 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=164, reqid=osd.0.0:164, at_version=59'73, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.963598244000003, 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015014527, 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.570 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569546+0000", 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569547+0000", 2024-04-26T02:25:21.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.4300000000000003e-07 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569597+0000", 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0417999999999997e-05 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569626+0000", 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9087000000000001e-05 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569648+0000", 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1869e-05 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569790+0000", 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014197 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569814+0000", 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3748999999999999e-05 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584483+0000", 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014669006 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584560+0000", 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7785000000000001e-05 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.ds5 59/31 ECSubWrite(tid=134, reqid=osd.12.0:134, at_version=59'52, trim_to=0'0, roll_forward_to=58'48))", 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:25:21.574 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.958053565999997, 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010327464999999999, 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575091+0000", 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575092+0000", 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.569999999999999e-07 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575136+0000", 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4712000000000002e-05 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575161+0000", 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4396000000000002e-05 2024-04-26T02:25:21.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575179+0000", 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8445999999999999e-05 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575319+0000", 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013968699999999999 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575344+0000", 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5153000000000001e-05 2024-04-26T02:25:21.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585327+0000", 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0099826429999999994 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.585418+0000", 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.1471000000000006e-05 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 59/31 ECSubWrite(tid=202, reqid=osd.6.0:202, at_version=59'31, trim_to=0'0, roll_forward_to=58'27))", 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.957900527, 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012320048, 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.579 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:25:21.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575244+0000", 2024-04-26T02:25:21.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575245+0000", 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1039999999999999e-06 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575287+0000", 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.2122000000000001e-05 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575310+0000", 2024-04-26T02:25:21.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3139999999999999e-05 2024-04-26T02:25:21.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575328+0000", 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7932e-05 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575669+0000", 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000340749 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575694+0000", 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5449999999999999e-05 2024-04-26T02:25:21.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587485+0000", 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01179094 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.587564+0000", 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.8610999999999997e-05 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.585 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.5s5 59/31 ECSubWrite(tid=72, reqid=osd.8.0:72, at_version=59'51, trim_to=0'0, roll_forward_to=58'49))", 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.957728764000002, 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013969232, 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575415+0000", 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575416+0000", 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.6000000000000004e-07 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575457+0000", 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1006e-05 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.587 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575475+0000", 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8280000000000001e-05 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575492+0000", 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6455000000000001e-05 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575788+0000", 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029676700000000003 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.575812+0000", 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3866000000000002e-05 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589304+0000", 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013491306999999999 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589385+0000", 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0990999999999998e-05 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.589 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 54.956834055000002, 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013188284, 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:25:21.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576310+0000", 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576312+0000", 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.88e-06 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576362+0000", 2024-04-26T02:25:21.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9518999999999998e-05 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576392+0000", 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0278999999999999e-05 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576413+0000", 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0879000000000001e-05 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576631+0000", 2024-04-26T02:25:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000217858 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576656+0000", 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5230000000000001e-05 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589395+0000", 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012739034999999999 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.589498+0000", 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00010360400000000001 2024-04-26T02:25:21.593 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:520 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 53.063742169000001, 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013039524, 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.594 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 520 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469402+0000", 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469405+0000", 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.993e-06 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469418+0000", 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2693e-05 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469453+0000", 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5679000000000002e-05 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469482+0000", 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8943000000000001e-05 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469661+0000", 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000178486 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469674+0000", 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3112000000000001e-05 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473010+0000", 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033360080000000001 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.473163+0000", 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000153323 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.474753+0000", 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001589752 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482102+0000", 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0073493830000000001 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482270+0000", 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000167176 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482442+0000", 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017197600000000001 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.599 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:521 3.bs0 3:db601e58:::smithi17529564-10:head [rollback d] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 53.063604189000003, 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013833965, 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 521 2024-04-26T02:25:21.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469540+0000", 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469541+0000", 2024-04-26T02:25:21.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.513e-06 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469548+0000", 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.0129999999999996e-06 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469570+0000", 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1146e-05 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469590+0000", 2024-04-26T02:25:21.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0089e-05 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469805+0000", 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000215672 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469818+0000", 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2527000000000001e-05 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476615+0000", 2024-04-26T02:25:21.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067965919999999997 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.476905+0000", 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029089300000000002 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.478553+0000", 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016476380000000001 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482879+0000", 2024-04-26T02:25:21.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043259839999999997 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483241+0000", 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00036179499999999999 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.483374+0000", 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000133103 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.605 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:522 3.bs0 3:db601e58:::smithi17529564-10:head [append 0~0] snapc 10=[10,f,d] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 53.063497681999998, 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015161644, 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 522 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469646+0000", 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469648+0000", 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.77e-06 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469654+0000", 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.117e-06 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469675+0000", 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0455e-05 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469692+0000", 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6900000000000001e-05 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469872+0000", 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017992299999999999 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.469881+0000", 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.5959999999999993e-06 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479445+0000", 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095639639999999995 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.479611+0000", 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016535200000000001 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.480621+0000", 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00101044 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.482888+0000", 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0022665620000000002 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484697+0000", 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0018098109999999999 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:28.484808+0000", 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000110754 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s1 66/31 ECSubWrite(tid=216, reqid=osd.6.0:216, at_version=66'46, trim_to=0'0, roll_forward_to=65'42))", 2024-04-26T02:25:21.611 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.055619538999998, 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.013025037999999999, 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477525+0000", 2024-04-26T02:25:21.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477526+0000", 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3e-06 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477587+0000", 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1579000000000001e-05 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477611+0000", 2024-04-26T02:25:21.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3560000000000001e-05 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.477623+0000", 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2149e-05 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480063+0000", 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0024397440000000002 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480088+0000", 2024-04-26T02:25:21.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5295000000000001e-05 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490508+0000", 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010419741 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490550+0000", 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1669999999999999e-05 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.615 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 66/31 ECSubWrite(tid=203, reqid=osd.0.0:203, at_version=66'106, trim_to=0'0, roll_forward_to=65'102))", 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 48.053972690000002, 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011565971, 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479171+0000", 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479172+0000", 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9500000000000001e-07 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479197+0000", 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5130000000000002e-05 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479209+0000", 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.15e-05 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.479218+0000", 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2199999999999998e-06 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480190+0000", 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00097207200000000004 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.480199+0000", 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3739999999999998e-06 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490652+0000", 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010453069000000001 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:33.490737+0000", 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5810999999999995e-05 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 92/31 ECSubWrite(tid=309, reqid=client.4589.0:769, at_version=92'163, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.905820365, 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018195949999999999, 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627324+0000", 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9699999999999995e-07 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629426+0000", 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021012890000000001 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629459+0000", 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2799000000000002e-05 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629482+0000", 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3833e-05 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629894+0000", 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00041181099999999999 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629923+0000", 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9172000000000001e-05 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645444+0000", 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015520734 2024-04-26T02:25:21.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645520+0000", 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5615e-05 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 92/31 ECSubWrite(tid=312, reqid=osd.0.0:312, at_version=92'165, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629545+0000", 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.90359956, 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016003218999999999, 2024-04-26T02:25:21.624 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629545+0000", 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629545+0000", 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629546+0000", 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.8599999999999996e-07 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629589+0000", 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.3096000000000002e-05 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629613+0000", 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3992e-05 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629631+0000", 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8303000000000001e-05 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634337+0000", 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0047058839999999996 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634364+0000", 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6936000000000001e-05 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.627 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645528+0000", 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011164121000000001 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645548+0000", 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9901000000000001e-05 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 92/31 ECSubWrite(tid=313, reqid=osd.0.0:313, at_version=92'167, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.634291+0000", 2024-04-26T02:25:21.628 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 21.898853346999999, 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011276860999999999, 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634291+0000", 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634291+0000", 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634293+0000", 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9989999999999998e-06 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634351+0000", 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.8671999999999997e-05 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634374+0000", 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2501999999999999e-05 2024-04-26T02:25:21.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.634393+0000", 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9262999999999998e-05 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635872+0000", 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0014787890000000001 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635888+0000", 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.632e-05 2024-04-26T02:25:21.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645552+0000", 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00966324 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645568+0000", 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6076e-05 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.632 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs1 101/31 ECSubWrite(tid=363, reqid=client.4589.0:856, at_version=101'211, trim_to=0'0, roll_forward_to=101'207))", 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.637129+0000", 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.896014812000001, 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014158004, 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637129+0000", 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:21.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637129+0000", 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.637131+0000", 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0650000000000001e-06 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638766+0000", 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0016347029999999999 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:21.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638796+0000", 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0219e-05 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638820+0000", 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3365000000000001e-05 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.638981+0000", 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016103800000000001 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:21.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.639008+0000", 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7169e-05 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.651147+0000", 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012139486999999999 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.651287+0000", 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000139958 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.636 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.637 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:21.637 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:21.637 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:21.638 INFO:teuthology.orchestra.run.smithi059.stderr:noscrub is unset 2024-04-26T02:25:21.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_ops_in_flight 2024-04-26T02:25:21.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T02:25:21.764 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:21.764 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:21.765 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:21.765 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:21.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_blocked_ops 2024-04-26T02:25:21.900 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:21.900 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:21.900 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:21.914 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.11.asok dump_historic_ops 2024-04-26T02:25:22.039 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:22.039 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:276 3.1s0 3:8c97d9d7:::smithi17529564-6:head [append 0~507904] snapc 5=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 71.876987421999999, 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015591825, 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.040 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 276 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158460+0000", 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.041 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158464+0000", 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4240000000000003e-06 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158778+0000", 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00031355400000000001 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158793+0000", 2024-04-26T02:25:22.042 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5654e-05 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158804+0000", 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0543000000000001e-05 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.158964+0000", 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015994199999999999 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.043 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.159116+0000", 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000152194 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.161895+0000", 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0027785510000000002 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173835+0000", 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011940014000000001 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.044 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.173974+0000", 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000139546 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.174052+0000", 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7403000000000004e-05 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:280 3.1s0 3:8c97d9d7:::smithi17529564-6:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e42)", 2024-04-26T02:25:22.045 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 71.869929393000007, 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018442278999999999, 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 280 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.046 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165518+0000", 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165519+0000", 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.047 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165523+0000", 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9400000000000004e-06 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165535+0000", 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2486e-05 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.048 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.165546+0000", 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0550000000000001e-05 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175360+0000", 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0098140950000000001 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.175447+0000", 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.7737000000000004e-05 2024-04-26T02:25:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179821+0000", 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0043734860000000002 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.179966+0000", 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00014539199999999999 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:10.183960+0000", 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0039937430000000001 2024-04-26T02:25:22.050 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:422 3.1s0 3:80641982:::smithi17529564-25:head [copy-from ver 55] snapc d=[d,c,6] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.203709420999999, 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.038918576000000003, 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.051 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 422 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831738+0000", 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.052 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831740+0000", 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5440000000000001e-06 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831752+0000", 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2041999999999999e-05 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831781+0000", 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8833999999999999e-05 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.053 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831794+0000", 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3349e-05 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831860+0000", 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5356000000000002e-05 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831926+0000", 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.6396000000000006e-05 2024-04-26T02:25:22.054 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.859553+0000", 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027626301999999998 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866678+0000", 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007125803 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870520+0000", 2024-04-26T02:25:22.055 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003841952 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.870656+0000", 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013599799999999999 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:423 3.1s0 3:80641982:::smithi17529564-25:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e55)", 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 59.203625580000001, 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.034213080999999999, 2024-04-26T02:25:22.056 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 423 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.057 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831822+0000", 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.5000000000000001e-07 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.058 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831827+0000", 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.792e-06 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831839+0000", 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1712000000000001e-05 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.831846+0000", 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9199999999999998e-06 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.059 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832063+0000", 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021765599999999999 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.832133+0000", 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9449999999999994e-05 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865896+0000", 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.033763107000000001 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.060 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.865962+0000", 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.5810999999999997e-05 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:22.866035+0000", 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.2782999999999998e-05 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.061 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:503 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.472739898, 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019134271000000001, 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 503 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.062 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562707+0000", 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562709+0000", 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1500000000000002e-06 2024-04-26T02:25:22.063 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.065 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562720+0000", 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0746e-05 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562740+0000", 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0370999999999999e-05 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562753+0000", 2024-04-26T02:25:22.066 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2561999999999999e-05 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562867+0000", 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000113841 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562881+0000", 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3709999999999999e-05 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569080+0000", 2024-04-26T02:25:22.067 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0061992339999999996 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.569415+0000", 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033499799999999998 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.581842+0000", 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012426659 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.068 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:504 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.472667504, 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020273925000000002, 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.069 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 504 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.070 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562780+0000", 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562781+0000", 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9600000000000008e-07 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562797+0000", 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6254000000000001e-05 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.071 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562809+0000", 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2204e-05 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562818+0000", 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.8459999999999997e-06 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562987+0000", 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016880399999999999 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.072 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562997+0000", 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0713000000000001e-05 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570438+0000", 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.007440894 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.570691+0000", 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025249400000000003 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.073 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.583054+0000", 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012362720000000001 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:505 3.1s0 3:84b104fd:::smithi17529564-9:d [read 0~147456,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e59)", 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.472613326999998, 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.032520136999999998, 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.074 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 505 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.075 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562834+0000", 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562835+0000", 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0200000000000001e-07 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562839+0000", 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.5839999999999996e-06 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.076 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562853+0000", 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4216000000000001e-05 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.562864+0000", 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0579e-05 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563046+0000", 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018216799999999999 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.077 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.563058+0000", 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1378e-05 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571720+0000", 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086620359999999997 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.571999+0000", 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027927099999999999 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.078 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595354+0000", 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.023355102999999999 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 59/31 ECSubReadReply(tid=45, attrs_read=0))", 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.455174157000002, 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015110926, 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.079 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:22.080 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.580273+0000", 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584305+0000", 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0040320649999999996 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.081 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.584322+0000", 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7076e-05 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.594641+0000", 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010319246000000001 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.595384+0000", 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00074253899999999996 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:560 3.1s0 3:80641982:::smithi17529564-25:head [append 0~770048] snapc 16=[15,14,13,12,11,10] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.473526653, 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018860572999999999, 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 560 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.083 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561920+0000", 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.561923+0000", 2024-04-26T02:25:22.084 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9890000000000001e-06 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562755+0000", 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00083166800000000003 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562788+0000", 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2960000000000003e-05 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.085 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562804+0000", 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5636000000000001e-05 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.562942+0000", 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000138271 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.563116+0000", 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017447599999999999 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.086 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.565388+0000", 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002271295 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574120+0000", 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0087317829999999999 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580556+0000", 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.006436509 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.580781+0000", 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022498599999999999 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:564 3.1s0 3:80641982:::smithi17529564-25:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e70)", 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 44.461314105, 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021517379, 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.088 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 564 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574133+0000", 2024-04-26T02:25:22.089 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574135+0000", 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.689e-06 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574143+0000", 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9270000000000005e-06 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574163+0000", 2024-04-26T02:25:22.090 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0392999999999999e-05 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.574183+0000", 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0210000000000001e-05 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581120+0000", 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069366829999999999 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:22.091 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.581385+0000", 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026519800000000002 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587167+0000", 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0057815389999999996 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.587435+0000", 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026854500000000003 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:37.595650+0000", 2024-04-26T02:25:22.092 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0082151949999999998 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:766 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.421078876999999, 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.031525108000000003, 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.093 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 766 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614368+0000", 2024-04-26T02:25:22.094 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614371+0000", 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9469999999999999e-06 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614402+0000", 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1068999999999997e-05 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.095 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614436+0000", 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4032000000000002e-05 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614464+0000", 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7484999999999999e-05 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614582+0000", 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000118195 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.096 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614596+0000", 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4127999999999999e-05 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.618371+0000", 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037749810000000002 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.618590+0000", 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00021933799999999999 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.097 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.645893+0000", 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.027302933000000001 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:767 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.420948648, 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.035408467999999998, 2024-04-26T02:25:22.098 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 767 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.099 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614498+0000", 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614499+0000", 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4e-07 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614505+0000", 2024-04-26T02:25:22.100 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.49e-06 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614520+0000", 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5119e-05 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614528+0000", 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4230000000000005e-06 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.101 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614744+0000", 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000215942 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614759+0000", 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5075999999999999e-05 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.621172+0000", 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0064126909999999999 2024-04-26T02:25:22.102 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.621439+0000", 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00026644700000000001 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.649907+0000", 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.028468340000000002 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.103 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:768 3.1s0 3:8c97d9d7:::smithi17529564-6:1a [read 0~4358144,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.420874787999999, 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.039201346999999998, 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 768 2024-04-26T02:25:22.104 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614572+0000", 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614573+0000", 2024-04-26T02:25:22.105 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6000000000000003e-07 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614578+0000", 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.933e-06 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614589+0000", 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1374e-05 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.106 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614598+0000", 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.2619999999999998e-06 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614806+0000", 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00020866 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.614817+0000", 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0992000000000001e-05 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.107 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627773+0000", 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012955250999999999 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.628082+0000", 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000309525 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.653774+0000", 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02569159 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.108 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 91/31 ECSubReadReply(tid=80, attrs_read=0))", 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.406316370999999, 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016880775000000001, 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.109 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629131+0000", 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629132+0000", 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.0999999999999997e-07 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630582+0000", 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001450231 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.110 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630599+0000", 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7272999999999999e-05 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630616+0000", 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7031e-05 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.111 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631422+0000", 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00080626000000000005 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646012+0000", 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01458917 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:22.112 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.405914859999999, 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020566872999999999, 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629532+0000", 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.113 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.629534+0000", 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6559999999999999e-06 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632692+0000", 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031580739999999999 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632723+0000", 2024-04-26T02:25:22.114 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.0953e-05 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632742+0000", 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8702000000000002e-05 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650038+0000", 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017296138999999999 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650099+0000", 2024-04-26T02:25:22.115 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.1348999999999998e-05 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 91/31 ECSubReadReply(tid=81, attrs_read=0))", 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.404806777000001, 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019366189999999998, 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.116 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630640+0000", 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.117 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.630641+0000", 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.1200000000000002e-07 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.631991+0000", 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001349615 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632006+0000", 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5162e-05 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.118 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632049+0000", 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.286e-05 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.646232+0000", 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014183039 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650007+0000", 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0037748019999999998 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.119 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.403377021000001, 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021746782999999999, 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.120 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632070+0000", 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.632071+0000", 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.9999999999999997e-07 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633377+0000", 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0013061100000000001 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.121 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633394+0000", 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7255999999999999e-05 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633438+0000", 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.4150000000000003e-05 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650410+0000", 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016971442999999999 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.122 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.653817+0000", 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0034072239999999999 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpReadReply(3.1s0 92/31 ECSubReadReply(tid=82, attrs_read=0))", 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:22.123 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.401892707000002, 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016622347999999999, 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633554+0000", 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.124 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.633555+0000", 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2399999999999996e-07 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635079+0000", 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001523216 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635097+0000", 2024-04-26T02:25:22.125 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8488999999999999e-05 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.635142+0000", 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.507e-05 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650125+0000", 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014982733 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.126 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.650177+0000", 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1916000000000002e-05 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:875 3.1s0 3:8c97d9d7:::smithi17529564-6:head [delete] snapc 27=[27,26,24,23,22,21,19,10] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e102)", 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:09.575270+0000", 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 12.460176736999999, 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015600602, 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.127 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 875 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575270+0000", 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575270+0000", 2024-04-26T02:25:22.128 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.129 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.129 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575274+0000", 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4740000000000001e-06 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575290+0000", 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6517000000000001e-05 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575326+0000", 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5185000000000003e-05 2024-04-26T02:25:22.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575344+0000", 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8270999999999998e-05 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575541+0000", 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00019670500000000001 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.575568+0000", 2024-04-26T02:25:22.131 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7402999999999998e-05 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.581789+0000", 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0062212980000000001 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.582109+0000", 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000319258 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.132 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.584427+0000", 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0023188729999999999 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.587421+0000", 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0029932399999999999 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.590433+0000", 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0030126839999999998 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.133 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.590871+0000", 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00043769399999999997 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:899 3.1s0 3:84b104fd:::smithi17529564-9:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e105)", 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:12.588480+0000", 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.4469669940000003, 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.01760811, 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.134 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 899 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588480+0000", 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.135 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588480+0000", 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588481+0000", 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3489999999999999e-06 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588487+0000", 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3109999999999996e-06 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.136 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588504+0000", 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7031e-05 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588517+0000", 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3168e-05 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588594+0000", 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.6582999999999995e-05 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.588603+0000", 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.2960000000000004e-06 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.595466+0000", 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0068628739999999997 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.595535+0000", 2024-04-26T02:25:22.138 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.9665000000000005e-05 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.602493+0000", 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0069576359999999997 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.602609+0000", 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00011613299999999999 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.139 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.606088+0000", 2024-04-26T02:25:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.003479064 2024-04-26T02:25:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.140 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.140 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:3.ds0 2024-04-26T02:25:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:3.cs2 2024-04-26T02:25:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:3.bs3 2024-04-26T02:25:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:3.as0 2024-04-26T02:25:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:3.6s4 2024-04-26T02:25:22.141 INFO:teuthology.orchestra.run.smithi059.stdout:3.3s6 2024-04-26T02:25:22.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_ops_in_flight 2024-04-26T02:25:22.270 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:22.270 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:22.270 INFO:teuthology.orchestra.run.smithi175.stdout: "num_ops": 0 2024-04-26T02:25:22.270 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:22.282 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_blocked_ops 2024-04-26T02:25:22.404 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [], 2024-04-26T02:25:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "complaint_time": 30, 2024-04-26T02:25:22.404 INFO:teuthology.orchestra.run.smithi175.stdout: "num_blocked_ops": 0 2024-04-26T02:25:22.405 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:22.418 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.15.asok dump_historic_ops 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: "size": 20, 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 600, 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: "ops": [ 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 59/31 ECSubWrite(tid=79, reqid=osd.13.0:77, at_version=0'0, trim_to=0'0, roll_forward_to=59'24))", 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.963359275999998, 2024-04-26T02:25:22.542 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015265225, 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576086+0000", 2024-04-26T02:25:22.543 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576087+0000", 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.33e-07 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576116+0000", 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9782999999999999e-05 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.544 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576138+0000", 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1696e-05 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576172+0000", 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3872999999999999e-05 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578894+0000", 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002721986 2024-04-26T02:25:22.545 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.578918+0000", 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4042000000000001e-05 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591165+0000", 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.012247417 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.546 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591351+0000", 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018549500000000001 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 59/31 ECSubWrite(tid=167, reqid=osd.0.0:167, at_version=59'75, trim_to=0'0, roll_forward_to=58'71))", 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 55.962997057999999, 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015022990999999999, 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.547 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576448+0000", 2024-04-26T02:25:22.548 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576450+0000", 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.72e-06 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576517+0000", 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.7062000000000003e-05 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.549 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576552+0000", 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.5466000000000002e-05 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576573+0000", 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0835999999999998e-05 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576692+0000", 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000119474 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.550 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.576717+0000", 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5032e-05 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591376+0000", 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014658857000000001 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:26.591471+0000", 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.4543999999999995e-05 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.551 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:704 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1212416,checksum,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.475570+0000", 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.063875123999999, 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.040836804999999997, 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 704 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.552 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475570+0000", 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475570+0000", 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475574+0000", 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1969999999999998e-06 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.553 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.554 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.554 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475596+0000", 2024-04-26T02:25:22.554 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1682e-05 2024-04-26T02:25:22.555 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.555 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.555 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.555 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475646+0000", 2024-04-26T02:25:22.555 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.0108000000000002e-05 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475670+0000", 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4414999999999999e-05 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475943+0000", 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00027292100000000003 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.556 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475966+0000", 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2493e-05 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.490144+0000", 2024-04-26T02:25:22.557 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014178893 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.490327+0000", 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00018234800000000001 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.558 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.516407+0000", 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.026079748 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:705 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1212416,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.475728+0000", 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.063717131000001, 2024-04-26T02:25:22.559 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.042587364000000003, 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 705 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475728+0000", 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.560 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475728+0000", 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475730+0000", 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7570000000000001e-06 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475740+0000", 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0409e-05 2024-04-26T02:25:22.561 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475764+0000", 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4352e-05 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475781+0000", 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7027000000000001e-05 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.562 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.476106+0000", 2024-04-26T02:25:22.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00032499500000000001 2024-04-26T02:25:22.563 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.563 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.563 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.563 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.476123+0000", 2024-04-26T02:25:22.563 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.6699000000000001e-05 2024-04-26T02:25:22.564 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.564 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.564 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.564 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509499+0000", 2024-04-26T02:25:22.564 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.033375828000000003 2024-04-26T02:25:22.565 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.565 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509658+0000", 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000158956 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518315+0000", 2024-04-26T02:25:22.566 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0086573410000000007 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:706 3.6s0 3:67e91997:::smithi17529564-21:head [read 0~1212416,checksum] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85)", 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.475806+0000", 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.063639177999999, 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.051274463999999999, 2024-04-26T02:25:22.567 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 706 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.568 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.569 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475806+0000", 2024-04-26T02:25:22.569 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.569 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.569 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.569 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475806+0000", 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475807+0000", 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2640000000000001e-06 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475817+0000", 2024-04-26T02:25:22.570 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.6460000000000005e-06 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475836+0000", 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9249000000000002e-05 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.475850+0000", 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3713000000000001e-05 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.477608+0000", 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001758304 2024-04-26T02:25:22.571 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.477622+0000", 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.366e-05 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518443+0000", 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.04082094 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518575+0000", 2024-04-26T02:25:22.572 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00013295399999999999 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527080+0000", 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0085047339999999999 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 85/31 ECSubWrite(tid=265, reqid=osd.0.0:265, at_version=85'138, trim_to=0'0, roll_forward_to=84'136))", 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:22.573 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.056264407, 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020183117, 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.574 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.483181+0000", 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5300000000000004e-07 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491563+0000", 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0083815980000000005 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.575 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491587+0000", 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4652999999999999e-05 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491609+0000", 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1322e-05 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491786+0000", 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017765500000000001 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.576 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491811+0000", 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4888999999999998e-05 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.503277+0000", 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011465981 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.503364+0000", 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.6465999999999995e-05 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.577 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 85/31 ECSubWrite(tid=141, reqid=osd.13.0:141, at_version=85'65, trim_to=0'0, roll_forward_to=83'63))", 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.491036+0000", 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.048408682000002, 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.036188466000000002, 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.578 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491036+0000", 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491036+0000", 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491037+0000", 2024-04-26T02:25:22.579 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.9999999999999996e-07 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491111+0000", 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.3520000000000001e-05 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491135+0000", 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4445000000000001e-05 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.580 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491150+0000", 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4617000000000001e-05 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510025+0000", 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.018875783 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.510050+0000", 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4476000000000001e-05 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.581 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527141+0000", 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.017090916000000001 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527225+0000", 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.3908999999999999e-05 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.es6 85/31 ECSubWrite(tid=142, reqid=osd.13.0:142, at_version=85'67, trim_to=0'0, roll_forward_to=83'63))", 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.491177+0000", 2024-04-26T02:25:22.582 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.048268021999998, 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.036116522999999998, 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491177+0000", 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491177+0000", 2024-04-26T02:25:22.583 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491178+0000", 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7700000000000004e-07 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491235+0000", 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.7688000000000001e-05 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.584 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491257+0000", 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2065e-05 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.491276+0000", 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8779000000000001e-05 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.520496+0000", 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.029219927999999999 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.585 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.520517+0000", 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1180000000000001e-05 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527238+0000", 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0067205839999999999 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.527293+0000", 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.5522000000000001e-05 2024-04-26T02:25:22.586 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 85/31 ECSubWrite(tid=259, reqid=osd.6.0:259, at_version=85'86, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.493164+0000", 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.046280462999999, 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016634302, 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.587 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493164+0000", 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493164+0000", 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493165+0000", 2024-04-26T02:25:22.588 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9200000000000002e-07 2024-04-26T02:25:22.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.589 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.589 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.589 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493207+0000", 2024-04-26T02:25:22.589 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.1788e-05 2024-04-26T02:25:22.589 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493229+0000", 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2657e-05 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493245+0000", 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5773e-05 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.590 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493398+0000", 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000153289 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.493423+0000", 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5119000000000001e-05 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509709+0000", 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016285612000000001 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.591 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.509799+0000", 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.9672000000000005e-05 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.0s6 85/31 ECSubWrite(tid=65, reqid=osd.1.0:65, at_version=85'51, trim_to=0'0, roll_forward_to=84'49))", 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.496962+0000", 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.042483130000001, 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.021392267999999999, 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.592 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496962+0000", 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496962+0000", 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.593 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.496963+0000", 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.66e-06 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497015+0000", 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.1387000000000001e-05 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497048+0000", 2024-04-26T02:25:22.594 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2975999999999997e-05 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497069+0000", 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.1438999999999999e-05 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497868+0000", 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00079878000000000002 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.595 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.497894+0000", 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.6239000000000001e-05 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518255+0000", 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020360481 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518354+0000", 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 9.9306000000000001e-05 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.596 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.8s4 85/31 ECSubWrite(tid=260, reqid=osd.6.0:260, at_version=85'88, trim_to=0'0, roll_forward_to=84'84))", 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:52.498394+0000", 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 30.041051197000002, 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020000166999999999, 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498394+0000", 2024-04-26T02:25:22.597 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498394+0000", 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498395+0000", 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.393e-06 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.598 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498444+0000", 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 4.9088000000000002e-05 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498469+0000", 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.4375e-05 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498488+0000", 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9565999999999999e-05 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.599 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498724+0000", 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00023578299999999999 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.498749+0000", 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.5089e-05 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518361+0000", 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.019611503999999998 2024-04-26T02:25:22.600 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:52.518394+0000", 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3368999999999998e-05 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:742 3.6s0 3:67e91997:::smithi17529564-21:head [append 0~720896] snapc 20=[20,1f,1d,1a,19,10] ondisk+write+known_if_redirected+supports_pool_eio e90)", 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:57.540798+0000", 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 24.998647183999999, 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.014839298000000001, 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.601 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 742 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.540798+0000", 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.602 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.540798+0000", 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.540801+0000", 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.1080000000000001e-06 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.541841+0000", 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0010405729999999999 2024-04-26T02:25:22.603 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.541880+0000", 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.9019e-05 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.541901+0000", 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0199000000000001e-05 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.542072+0000", 2024-04-26T02:25:22.604 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000171368 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.542375+0000", 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030326399999999997 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.545525+0000", 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0031498519999999999 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.605 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.548885+0000", 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0033602469999999998 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.555387+0000", 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0065013880000000003 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:57.555637+0000", 2024-04-26T02:25:22.606 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00025028000000000002 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 92/31 ECSubWrite(tid=309, reqid=client.4589.0:769, at_version=92'163, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.627995+0000", 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.911449880999999, 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016936414, 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.607 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627995+0000", 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627995+0000", 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.627996+0000", 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.2500000000000005e-07 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.608 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.636843+0000", 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0088477060000000003 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.636877+0000", 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.3855e-05 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.636900+0000", 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.2991999999999999e-05 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.609 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637023+0000", 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000122767 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637041+0000", 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7801000000000001e-05 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.644894+0000", 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0078528009999999995 2024-04-26T02:25:22.610 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.644931+0000", 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.7867000000000002e-05 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "MOSDECSubOpWrite(3.cs6 92/31 ECSubWrite(tid=314, reqid=client.4589.0:770, at_version=92'168, trim_to=0'0, roll_forward_to=90'162))", 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:24:59.637191+0000", 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 22.902253596000001, 2024-04-26T02:25:22.611 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015130242, 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "reached pg", 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637191+0000", 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637191+0000", 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.612 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637192+0000", 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.5000000000000002e-07 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637532+0000", 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00033956299999999997 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637552+0000", 2024-04-26T02:25:22.613 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0630000000000001e-05 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.637568+0000", 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.5826000000000001e-05 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.643067+0000", 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054988709999999998 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.614 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.643096+0000", 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.8962000000000002e-05 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.652298+0000", 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0092020309999999994 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:24:59.652322+0000", 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.3609e-05 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.615 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(osd.12.24:5 3.6s0 3:67e91997:::smithi17529564-21:head [assert-version v68,copy-get max 8388608] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101)", 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:08.520777+0000", 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 14.018668348, 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.02220049, 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.520777+0000", 2024-04-26T02:25:22.616 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.520777+0000", 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.520780+0000", 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.8999999999999999e-06 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.617 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.520801+0000", 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.0335000000000001e-05 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.520835+0000", 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.4128999999999998e-05 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.520852+0000", 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.696e-05 2024-04-26T02:25:22.618 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.520996+0000", 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000143862 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.521010+0000", 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4577e-05 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.526439+0000", 2024-04-26T02:25:22.619 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0054285619999999996 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.526892+0000", 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00045302599999999998 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:08.542977+0000", 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016085138999999998 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.620 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:870 3.6s0 3:638d7cd2:::smithi17529564-47:head [copy-from ver 81] snapc 27=[27,26,24,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:09.530241+0000", 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.009204177999999, 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.091905890000000004, 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 870 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.621 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530241+0000", 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530241+0000", 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530243+0000", 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.7329999999999999e-06 2024-04-26T02:25:22.622 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530257+0000", 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3298999999999999e-05 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530289+0000", 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2273000000000001e-05 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530306+0000", 2024-04-26T02:25:22.623 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.7272999999999999e-05 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530470+0000", 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00016318800000000001 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530489+0000", 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.9372999999999999e-05 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.624 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.535132+0000", 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.004643543 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.535418+0000", 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028528899999999999 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.603057+0000", 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.067639404 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.625 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.613842+0000", 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.010784847 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.621477+0000", 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0076347339999999998 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.622147+0000", 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00066993399999999996 2024-04-26T02:25:22.626 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:871 3.6s0 3:638d7cd2:::smithi17529564-47:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e102)", 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:09.530347+0000", 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 13.009097721, 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.081999474000000003, 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.627 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 871 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530347+0000", 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530347+0000", 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.628 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530349+0000", 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.333e-06 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530355+0000", 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 6.8530000000000003e-06 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530385+0000", 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.9465999999999999e-05 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.629 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530395+0000", 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0319000000000001e-05 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530593+0000", 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000197732 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.530606+0000", 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3359e-05 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.630 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.535780+0000", 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051734379999999998 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for blocked object", 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.535880+0000", 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000100647 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.611467+0000", 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.075586692999999996 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.631 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.611769+0000", 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00030213100000000002 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:09.612347+0000", 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00057750300000000004 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:888 3.6s0 3:638d7cd2:::smithi17529564-47:head [append 0~114688] snapc 29=[29,28,27,26,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:12.569231+0000", 2024-04-26T02:25:22.632 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9702138680000001, 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.015735710999999999, 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 888 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569231+0000", 2024-04-26T02:25:22.633 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569231+0000", 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569233+0000", 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 2.356e-06 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.634 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569412+0000", 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00017810300000000001 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569444+0000", 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.2428999999999997e-05 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569462+0000", 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8352e-05 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.635 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569621+0000", 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015878299999999999 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "op must wait for map", 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569640+0000", 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.8729e-05 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.574747+0000", 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0051070769999999998 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.636 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.574997+0000", 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024976099999999998 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.577125+0000", 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021288050000000001 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.582985+0000", 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0058598369999999997 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.637 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.584743+0000", 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.001757387 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.584967+0000", 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00022409200000000001 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.638 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:889 3.6s0 3:638d7cd2:::smithi17529564-47:head [setxattr _header (57) in=7b] snapc 29=[29,28,27,26,23,22,21,19,10] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:12.569497+0000", 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9699475589999995, 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.016791685000000001, 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 889 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.639 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569497+0000", 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569497+0000", 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569498+0000", 2024-04-26T02:25:22.640 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.1030000000000001e-06 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569504+0000", 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 5.3070000000000002e-06 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569518+0000", 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.3842999999999999e-05 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.641 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569528+0000", 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0190000000000001e-05 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569777+0000", 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00024929299999999999 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569792+0000", 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.4416999999999999e-05 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.642 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.579334+0000", 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0095424350000000002 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.579568+0000", 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000234007 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_started", 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.580825+0000", 2024-04-26T02:25:22.643 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0012575430000000001 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "sub_op_committed", 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.583827+0000", 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0030019489999999999 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "commit_sent", 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.585990+0000", 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0021624859999999999 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.644 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.586289+0000", 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00029911199999999998 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "description": "osd_op(client.4589.0:890 3.6s0 3:638d7cd2:::smithi17529564-47:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e105)", 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "initiated_at": "2024-04-26T02:25:12.569540+0000", 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "age": 9.9699046669999998, 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.020177885, 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "continuous": false, 2024-04-26T02:25:22.645 INFO:teuthology.orchestra.run.smithi175.stdout: "type_data": { 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "flag_point": "started", 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "client_info": { 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "client": "client.4589", 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "client_addr": "172.21.15.175:0/1048253316", 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "tid": 890 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "events": [ 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "initiated", 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569540+0000", 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.646 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "header_read", 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569540+0000", 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "throttled", 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569541+0000", 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 7.7000000000000004e-07 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.647 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "all_read", 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569545+0000", 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 3.6169999999999998e-06 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "dispatched", 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569555+0000", 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.0560000000000001e-05 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "queued_for_pg", 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569564+0000", 2024-04-26T02:25:22.648 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 8.4030000000000007e-06 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569851+0000", 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00028783900000000002 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting_for_map not empty", 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.569864+0000", 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 1.2546e-05 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.649 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.581528+0000", 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.011664051999999999 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "waiting for rw locks", 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.581813+0000", 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.000285335 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "reached_pg", 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.586797+0000", 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.0049840570000000001 2024-04-26T02:25:22.650 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "started", 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.586951+0000", 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.00015392699999999999 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: "event": "done", 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: "time": "2024-04-26T02:25:12.589718+0000", 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: "duration": 0.002766779 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.651 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.652 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-26T02:25:22.652 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-26T02:25:22.652 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-26T02:25:22.653 INFO:teuthology.orchestra.run.smithi059.stderr:nodeep-scrub is unset 2024-04-26T02:25:22.654 INFO:tasks.thrashosds.thrasher:Moving pg 2.3 from osd.14 to osd.12 2024-04-26T02:25:22.654 INFO:tasks.thrashosds.thrasher:Transfer export file from ubuntu@smithi142.front.sepia.ceph.com to ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:25:22.654 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-04-26T02:25:22.670 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-04-26T02:25:22.683 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-26T02:25:22.718 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.zG8LCIMDus 2024-04-26T02:25:22.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /var/log/ceph/exp.2.3.14 /tmp/tmp.zG8LCIMDus 2024-04-26T02:25:22.775 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.zG8LCIMDus 2024-04-26T02:25:22.888 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.zG8LCIMDus is 11KB 2024-04-26T02:25:22.902 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.zG8LCIMDus 2024-04-26T02:25:22.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-12 --journal-path /var/lib/ceph/osd/ceph-12/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.3.14 2024-04-26T02:25:24.085 INFO:teuthology.orchestra.run.smithi059.stdout:get_pg_num_history pg_num_history pg_num_history(e106 pg_nums {1={23=1},2={26=8},3={31=16}} deleted_pools ) 2024-04-26T02:25:24.085 INFO:teuthology.orchestra.run.smithi059.stdout:Importing pgid 2.3 2024-04-26T02:25:24.085 INFO:teuthology.orchestra.run.smithi059.stdout:write_pg epoch 68 info 2.3( empty local-lis/les=26/27 n=0 ec=26/26 lis/c=26/26 les/c/f=27/27/0 sis=26) 2024-04-26T02:25:24.085 INFO:teuthology.orchestra.run.smithi059.stdout:Import successful 2024-04-26T02:25:24.631 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /var/log/ceph/exp.2.3.14 2024-04-26T02:25:24.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f /var/log/ceph/exp.2.3.14 2024-04-26T02:25:24.844 INFO:tasks.thrashosds.thrasher:checking if target objectstore is bluestore on osd.12 2024-04-26T02:25:24.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-12 show-label 2024-04-26T02:25:24.933 INFO:teuthology.orchestra.run.smithi059.stdout:inferring bluefs devices from bluestore path 2024-04-26T02:25:24.934 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:24.934 INFO:teuthology.orchestra.run.smithi059.stdout: "/var/lib/ceph/osd/ceph-12/block": { 2024-04-26T02:25:24.934 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_uuid": "3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2", 2024-04-26T02:25:24.934 INFO:teuthology.orchestra.run.smithi059.stdout: "size": 96636764160, 2024-04-26T02:25:24.934 INFO:teuthology.orchestra.run.smithi059.stdout: "btime": "2024-04-26T02:22:35.286910+0000", 2024-04-26T02:25:24.935 INFO:teuthology.orchestra.run.smithi059.stdout: "description": "main", 2024-04-26T02:25:24.935 INFO:teuthology.orchestra.run.smithi059.stdout: "bfm_blocks": "23592960", 2024-04-26T02:25:24.935 INFO:teuthology.orchestra.run.smithi059.stdout: "bfm_blocks_per_key": "128", 2024-04-26T02:25:24.935 INFO:teuthology.orchestra.run.smithi059.stdout: "bfm_bytes_per_block": "4096", 2024-04-26T02:25:24.935 INFO:teuthology.orchestra.run.smithi059.stdout: "bfm_size": "96636764160", 2024-04-26T02:25:24.935 INFO:teuthology.orchestra.run.smithi059.stdout: "bluefs": "1", 2024-04-26T02:25:24.935 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_fsid": "83ecef7b-067c-41a4-8f83-dfa16b8b2690", 2024-04-26T02:25:24.936 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version_when_created": "ceph version 19.0.0-2457-gddeaa917 (ddeaa91797339a19172c3036ff48cca58c12f448) squid (dev)", 2024-04-26T02:25:24.936 INFO:teuthology.orchestra.run.smithi059.stdout: "created_at": "2024-04-26T02:22:37.720860Z", 2024-04-26T02:25:24.936 INFO:teuthology.orchestra.run.smithi059.stdout: "elastic_shared_blobs": "1", 2024-04-26T02:25:24.936 INFO:teuthology.orchestra.run.smithi059.stdout: "kv_backend": "rocksdb", 2024-04-26T02:25:24.936 INFO:teuthology.orchestra.run.smithi059.stdout: "magic": "ceph osd volume v026", 2024-04-26T02:25:24.937 INFO:teuthology.orchestra.run.smithi059.stdout: "mkfs_done": "yes", 2024-04-26T02:25:24.937 INFO:teuthology.orchestra.run.smithi059.stdout: "ready": "ready", 2024-04-26T02:25:24.937 INFO:teuthology.orchestra.run.smithi059.stdout: "require_osd_release": "19", 2024-04-26T02:25:24.937 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": "12" 2024-04-26T02:25:24.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-26T02:25:24.938 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:24.939 INFO:tasks.thrashosds.thrasher:checking if target bluestore supports sharding on osd.12 2024-04-26T02:25:24.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-12 show-sharding 2024-04-26T02:25:25.801 INFO:teuthology.orchestra.run.smithi059.stdout:m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32 2024-04-26T02:25:25.808 INFO:tasks.thrashosds.thrasher:applying new sharding to bluestore on osd.12 2024-04-26T02:25:25.808 INFO:tasks.thrashosds.thrasher:generate random sharding 2024-04-26T02:25:25.809 INFO:tasks.thrashosds.thrasher:applying new sharding: 2024-04-26T02:25:25.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-12 --sharding '' reshard 2024-04-26T02:25:26.210 INFO:teuthology.orchestra.run.smithi059.stdout:reshard success 2024-04-26T02:25:26.644 INFO:tasks.thrashosds.thrasher:running fsck to verify new sharding on osd.12 2024-04-26T02:25:26.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph-bluestore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/bluestore_tool.$pid.log' --log-level=10 --path /var/lib/ceph/osd/ceph-12 fsck 2024-04-26T02:25:27.477 INFO:teuthology.orchestra.run.smithi059.stdout:fsck success 2024-04-26T02:25:27.491 INFO:tasks.thrashosds.thrasher:resharding successfully completed 2024-04-26T02:25:27.491 INFO:tasks.thrashosds.thrasher:Reviving osd 14 2024-04-26T02:25:27.491 INFO:tasks.ceph.osd.14:Restarting daemon 2024-04-26T02:25:27.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 14 2024-04-26T02:25:27.494 INFO:tasks.ceph.osd.14:Started 2024-04-26T02:25:27.494 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:no valid command found; 10 closest matches: 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:0 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:1 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:abort 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:assert 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:config diff 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:config diff get 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:config get 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:config help [] 2024-04-26T02:25:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:config set ... 2024-04-26T02:25:27.611 INFO:teuthology.orchestra.run.smithi142.stderr:admin_socket: invalid command 2024-04-26T02:25:27.612 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T02:25:27.613 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-14, ['dump_ops_in_flight'] 2024-04-26T02:25:28.104 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:25:28.098+0000 7f6d76d5b7c0 -1 Falling back to public interface 2024-04-26T02:25:31.862 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:25:31.854+0000 7f6d76d5b7c0 -1 osd.14 94 log_to_monitors true 2024-04-26T02:25:32.614 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:no valid command found; 10 closest matches: 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:0 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:1 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:2 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:abort 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:assert 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:bluefs debug_inject_read_zeros 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:bluefs files list 2024-04-26T02:25:32.740 INFO:teuthology.orchestra.run.smithi142.stderr:bluefs stats 2024-04-26T02:25:32.741 INFO:teuthology.orchestra.run.smithi142.stderr:bluestore allocator dump block 2024-04-26T02:25:32.741 INFO:teuthology.orchestra.run.smithi142.stderr:bluestore allocator fragmentation block 2024-04-26T02:25:32.741 INFO:teuthology.orchestra.run.smithi142.stderr:admin_socket: invalid command 2024-04-26T02:25:32.743 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T02:25:32.744 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-14, ['dump_ops_in_flight'] 2024-04-26T02:25:33.798 INFO:tasks.ceph.osd.14.smithi142.stderr:2024-04-26T02:25:33.794+0000 7f6d6ab28640 -1 osd.14 94 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:25:37.745 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.14.asok dump_ops_in_flight 2024-04-26T02:25:37.876 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-26T02:25:37.876 INFO:teuthology.orchestra.run.smithi142.stdout: "ops": [], 2024-04-26T02:25:37.876 INFO:teuthology.orchestra.run.smithi142.stdout: "num_ops": 0 2024-04-26T02:25:37.876 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-26T02:25:37.889 INFO:tasks.thrashosds.thrasher:test_bluestore_reshard completed 2024-04-26T02:25:42.891 INFO:tasks.thrashosds.thrasher:reviving osd 2024-04-26T02:25:42.891 INFO:tasks.thrashosds.thrasher:Reviving osd 12 2024-04-26T02:25:42.891 INFO:tasks.ceph.osd.12:Restarting daemon 2024-04-26T02:25:42.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 12 2024-04-26T02:25:42.894 INFO:tasks.ceph.osd.12:Started 2024-04-26T02:25:42.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:25:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:no valid command found; 10 closest matches: 2024-04-26T02:25:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:0 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:1 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:abort 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:assert 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:config diff 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:config diff get 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:config get 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:config help [] 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:config set ... 2024-04-26T02:25:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:admin_socket: invalid command 2024-04-26T02:25:43.022 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T02:25:43.023 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-12, ['dump_ops_in_flight'] 2024-04-26T02:25:43.498 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:43.494+0000 7f0e3311e7c0 -1 Falling back to public interface 2024-04-26T02:25:47.278 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:47.273+0000 7f0e3311e7c0 -1 osd.12 106 log_to_monitors true 2024-04-26T02:25:47.937 INFO:tasks.ceph.osd.12.smithi059.stderr:2024-04-26T02:25:47.933+0000 7f0e26eeb640 -1 osd.12 106 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T02:25:48.023 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.12.asok dump_ops_in_flight 2024-04-26T02:25:48.160 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:25:48.160 INFO:teuthology.orchestra.run.smithi059.stdout: "ops": [], 2024-04-26T02:25:48.161 INFO:teuthology.orchestra.run.smithi059.stdout: "num_ops": 0 2024-04-26T02:25:48.161 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:25:48.175 INFO:tasks.thrashosds.thrasher:inning osd 2024-04-26T02:25:48.175 INFO:tasks.thrashosds.thrasher:Adding osd 12 2024-04-26T02:25:48.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 12 2024-04-26T02:25:48.501 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-26T02:25:48.497+0000 7f2c4020a640 -1 mon.a@0(leader).osd e117 definitely_dead 0 2024-04-26T02:25:48.913 INFO:teuthology.orchestra.run.smithi059.stderr:marked in osd.12. 2024-04-26T02:25:48.938 INFO:tasks.thrashosds.thrasher:Added osd 12 2024-04-26T02:25:48.938 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T02:25:49.081 INFO:teuthology.orchestra.run.smithi059.stdout:mon.a: {} 2024-04-26T02:25:49.082 INFO:teuthology.orchestra.run.smithi059.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T02:25:49.098 INFO:teuthology.orchestra.run.smithi059.stdout:mon.b: {} 2024-04-26T02:25:49.098 INFO:teuthology.orchestra.run.smithi059.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T02:25:49.110 INFO:teuthology.orchestra.run.smithi059.stdout:mon.c: {} 2024-04-26T02:25:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T02:25:49.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T02:25:49.925 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T02:25:49.948 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T02:25:50.939 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T02:25:50.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-26T02:25:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.4 to 1 (10000) 2024-04-26T02:25:51.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-26T02:25:52.954 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-26T02:25:52.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 8 1 2024-04-26T02:25:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.8 to 1 (10000) 2024-04-26T02:25:53.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 8 1 2024-04-26T02:25:54.982 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.8 primary-affinity to 1 (8655362) 2024-04-26T02:25:55.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T02:25:55.990 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T02:25:56.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T02:25:56.999 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T02:25:57.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-26T02:25:58.001 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.5 to 1 (10000) 2024-04-26T02:25:58.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-26T02:25:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-26T02:25:59.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 9 1 2024-04-26T02:26:00.026 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.9 to 1 (10000) 2024-04-26T02:26:00.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 9 1 2024-04-26T02:26:01.039 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.9 primary-affinity to 1 (8655362) 2024-04-26T02:26:01.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 13 1 2024-04-26T02:26:02.048 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.13 to 1 (10000) 2024-04-26T02:26:02.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 13 1 2024-04-26T02:26:03.058 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.13 primary-affinity to 1 (8655362) 2024-04-26T02:26:03.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T02:26:04.067 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T02:26:04.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T02:26:05.077 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T02:26:05.103 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-26T02:26:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.6 to 1 (10000) 2024-04-26T02:26:06.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-26T02:26:07.110 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-26T02:26:07.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 10 1 2024-04-26T02:26:08.113 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.10 to 1 (10000) 2024-04-26T02:26:08.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 10 1 2024-04-26T02:26:09.128 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.10 primary-affinity to 1 (8655362) 2024-04-26T02:26:09.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-26T02:26:10.136 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.3 to 1 (10000) 2024-04-26T02:26:10.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-26T02:26:10.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:26:10.501+0000 7f33cffff640 0 --2- 172.21.15.59:0/888090728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d8151ad0 0x7f33d81f44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-04-26T02:26:11.139 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-26T02:26:11.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-26T02:26:12.150 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.7 to 1 (10000) 2024-04-26T02:26:12.175 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-26T02:26:13.161 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-26T02:26:13.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 11 1 2024-04-26T02:26:14.172 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.11 to 1 (10000) 2024-04-26T02:26:14.196 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 11 1 2024-04-26T02:26:15.187 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.11 primary-affinity to 1 (8655362) 2024-04-26T02:26:15.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 15 1 2024-04-26T02:26:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.15 to 1 (10000) 2024-04-26T02:26:16.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 15 1 2024-04-26T02:26:17.206 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.15 primary-affinity to 1 (8655362) 2024-04-26T02:26:17.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 14 1 2024-04-26T02:26:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.14 to 1 (10000) 2024-04-26T02:26:18.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 14 1 2024-04-26T02:26:19.222 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.14 primary-affinity to 1 (8655362) 2024-04-26T02:26:19.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 12 1 2024-04-26T02:26:20.232 INFO:teuthology.orchestra.run.smithi059.stderr:reweighted osd.12 to 1 (10000) 2024-04-26T02:26:20.256 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 12 1 2024-04-26T02:26:21.251 INFO:teuthology.orchestra.run.smithi059.stderr:set osd.12 primary-affinity to 1 (8655362) 2024-04-26T02:26:21.274 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T02:26:21.274 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T02:26:21.274 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T02:26:21.274 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T02:26:21.274 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T02:26:21.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T02:26:21.578 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:21.578 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":150,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:26:21.239670+0000","last_up_change":"2024-04-26T02:25:48.908541+0000","last_in_change":"2024-04-26T02:25:48.908541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T02:23:46.791952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T02:23:48.950495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6803","nonce":2847130092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6805","nonce":2847130092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6809","nonce":2847130092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6807","nonce":2847130092}]},"public_addr":"172.21.15.59:6803/2847130092","cluster_addr":"172.21.15.59:6805/2847130092","heartbeat_back_addr":"172.21.15.59:6809/2847130092","heartbeat_front_addr":"172.21.15.59:6807/2847130092","state":["exists","up"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6813","nonce":504096392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6821","nonce":504096392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6829","nonce":504096392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6826","nonce":504096392}]},"public_addr":"172.21.15.136:6813/504096392","cluster_addr":"172.21.15.136:6821/504096392","heartbeat_back_addr":"172.21.15.136:6829/504096392","heartbeat_front_addr":"172.21.15.136:6826/504096392","state":["exists","up"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6801","nonce":785558131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6803","nonce":785558131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6807","nonce":785558131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6805","nonce":785558131}]},"public_addr":"172.21.15.142:6801/785558131","cluster_addr":"172.21.15.142:6803/785558131","heartbeat_back_addr":"172.21.15.142:6807/785558131","heartbeat_front_addr":"172.21.15.142:6805/785558131","state":["exists","up"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6801","nonce":3691596427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6803","nonce":3691596427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6807","nonce":3691596427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6805","nonce":3691596427}]},"public_addr":"172.21.15.175:6801/3691596427","cluster_addr":"172.21.15.175:6803/3691596427","heartbeat_back_addr":"172.21.15.175:6807/3691596427","heartbeat_front_addr":"172.21.15.175:6805/3691596427","state":["exists","up"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6821","nonce":2291404497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6823","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6825","nonce":2291404497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6831","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6833","nonce":2291404497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6827","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6829","nonce":2291404497}]},"public_addr":"172.21.15.59:6821/2291404497","cluster_addr":"172.21.15.59:6825/2291404497","heartbeat_back_addr":"172.21.15.59:6833/2291404497","heartbeat_front_addr":"172.21.15.59:6829/2291404497","state":["exists","up"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6815","nonce":3420144978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6823","nonce":3420144978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6831","nonce":3420144978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6827","nonce":3420144978}]},"public_addr":"172.21.15.136:6815/3420144978","cluster_addr":"172.21.15.136:6823/3420144978","heartbeat_back_addr":"172.21.15.136:6831/3420144978","heartbeat_front_addr":"172.21.15.136:6827/3420144978","state":["exists","up"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6825","nonce":2443484296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6827","nonce":2443484296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6831","nonce":2443484296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6829","nonce":2443484296}]},"public_addr":"172.21.15.142:6825/2443484296","cluster_addr":"172.21.15.142:6827/2443484296","heartbeat_back_addr":"172.21.15.142:6831/2443484296","heartbeat_front_addr":"172.21.15.142:6829/2443484296","state":["exists","up"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6809","nonce":1727563740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6811","nonce":1727563740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6815","nonce":1727563740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6813","nonce":1727563740}]},"public_addr":"172.21.15.175:6809/1727563740","cluster_addr":"172.21.15.175:6811/1727563740","heartbeat_back_addr":"172.21.15.175:6815/1727563740","heartbeat_front_addr":"172.21.15.175:6813/1727563740","state":["exists","up"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6820","nonce":652278083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6824","nonce":652278083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6832","nonce":652278083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6828","nonce":652278083}]},"public_addr":"172.21.15.59:6820/652278083","cluster_addr":"172.21.15.59:6824/652278083","heartbeat_back_addr":"172.21.15.59:6832/652278083","heartbeat_front_addr":"172.21.15.59:6828/652278083","state":["exists","up"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6802","nonce":1522341187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6806","nonce":1522341187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6820","nonce":1522341187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6812","nonce":1522341187}]},"public_addr":"172.21.15.136:6802/1522341187","cluster_addr":"172.21.15.136:6806/1522341187","heartbeat_back_addr":"172.21.15.136:6820/1522341187","heartbeat_front_addr":"172.21.15.136:6812/1522341187","state":["exists","up"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6810","nonce":2358058219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6813","nonce":2358058219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6819","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6820","nonce":2358058219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6815","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6817","nonce":2358058219}]},"public_addr":"172.21.15.142:6810/2358058219","cluster_addr":"172.21.15.142:6813/2358058219","heartbeat_back_addr":"172.21.15.142:6820/2358058219","heartbeat_front_addr":"172.21.15.142:6817/2358058219","state":["exists","up"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6825","nonce":3853198939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6827","nonce":3853198939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6831","nonce":3853198939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6829","nonce":3853198939}]},"public_addr":"172.21.15.175:6825/3853198939","cluster_addr":"172.21.15.175:6827/3853198939","heartbeat_back_addr":"172.21.15.175:6831/3853198939","heartbeat_front_addr":"172.21.15.175:6829/3853198939","state":["exists","up"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":24,"last_clean_end":106,"up_from":118,"up_thru":31,"down_at":107,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6811","nonce":2475559692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6813","nonce":2475559692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6817","nonce":2475559692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6815","nonce":2475559692}]},"public_addr":"172.21.15.59:6811/2475559692","cluster_addr":"172.21.15.59:6813/2475559692","heartbeat_back_addr":"172.21.15.59:6817/2475559692","heartbeat_front_addr":"172.21.15.59:6815/2475559692","state":["exists","up"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6803","nonce":2997471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6807","nonce":2997471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6822","nonce":2997471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6814","nonce":2997471095}]},"public_addr":"172.21.15.136:6803/2997471095","cluster_addr":"172.21.15.136:6807/2997471095","heartbeat_back_addr":"172.21.15.136:6822/2997471095","heartbeat_front_addr":"172.21.15.136:6814/2997471095","state":["exists","up"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":22,"last_clean_end":94,"up_from":115,"up_thru":115,"down_at":95,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6811","nonce":1330819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6816","nonce":1330819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6823","nonce":1330819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6821","nonce":1330819645}]},"public_addr":"172.21.15.142:6811/1330819645","cluster_addr":"172.21.15.142:6816/1330819645","heartbeat_back_addr":"172.21.15.142:6823/1330819645","heartbeat_front_addr":"172.21.15.142:6821/1330819645","state":["exists","up"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6817","nonce":1433451080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6819","nonce":1433451080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6823","nonce":1433451080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6821","nonce":1433451080}]},"public_addr":"172.21.15.175:6817/1433451080","cluster_addr":"172.21.15.175:6819/1433451080","heartbeat_back_addr":"172.21.15.175:6823/1433451080","heartbeat_front_addr":"172.21.15.175:6821/1433451080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:55.274534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:54.964426+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:02.389817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:14.926487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:17.830297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:02.217303+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.697164+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:15.603368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.115446+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:03.922985+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:11.660886+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:18.192320+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:14.230296+0000","dead_epoch":107},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:01.719519+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:33.819450+0000","dead_epoch":95},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:15.445311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":26,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":36,"length":4},{"begin":41,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:26:21.597 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T02:26:21.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T02:26:21.895 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:21.896 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":150,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:26:21.239670+0000","last_up_change":"2024-04-26T02:25:48.908541+0000","last_in_change":"2024-04-26T02:25:48.908541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T02:23:46.791952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T02:23:48.950495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6803","nonce":2847130092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6805","nonce":2847130092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6809","nonce":2847130092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6807","nonce":2847130092}]},"public_addr":"172.21.15.59:6803/2847130092","cluster_addr":"172.21.15.59:6805/2847130092","heartbeat_back_addr":"172.21.15.59:6809/2847130092","heartbeat_front_addr":"172.21.15.59:6807/2847130092","state":["exists","up"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6813","nonce":504096392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6821","nonce":504096392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6829","nonce":504096392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6826","nonce":504096392}]},"public_addr":"172.21.15.136:6813/504096392","cluster_addr":"172.21.15.136:6821/504096392","heartbeat_back_addr":"172.21.15.136:6829/504096392","heartbeat_front_addr":"172.21.15.136:6826/504096392","state":["exists","up"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6801","nonce":785558131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6803","nonce":785558131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6807","nonce":785558131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6805","nonce":785558131}]},"public_addr":"172.21.15.142:6801/785558131","cluster_addr":"172.21.15.142:6803/785558131","heartbeat_back_addr":"172.21.15.142:6807/785558131","heartbeat_front_addr":"172.21.15.142:6805/785558131","state":["exists","up"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6801","nonce":3691596427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6803","nonce":3691596427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6807","nonce":3691596427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6805","nonce":3691596427}]},"public_addr":"172.21.15.175:6801/3691596427","cluster_addr":"172.21.15.175:6803/3691596427","heartbeat_back_addr":"172.21.15.175:6807/3691596427","heartbeat_front_addr":"172.21.15.175:6805/3691596427","state":["exists","up"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6821","nonce":2291404497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6823","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6825","nonce":2291404497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6831","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6833","nonce":2291404497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6827","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6829","nonce":2291404497}]},"public_addr":"172.21.15.59:6821/2291404497","cluster_addr":"172.21.15.59:6825/2291404497","heartbeat_back_addr":"172.21.15.59:6833/2291404497","heartbeat_front_addr":"172.21.15.59:6829/2291404497","state":["exists","up"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6815","nonce":3420144978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6823","nonce":3420144978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6831","nonce":3420144978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6827","nonce":3420144978}]},"public_addr":"172.21.15.136:6815/3420144978","cluster_addr":"172.21.15.136:6823/3420144978","heartbeat_back_addr":"172.21.15.136:6831/3420144978","heartbeat_front_addr":"172.21.15.136:6827/3420144978","state":["exists","up"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6825","nonce":2443484296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6827","nonce":2443484296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6831","nonce":2443484296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6829","nonce":2443484296}]},"public_addr":"172.21.15.142:6825/2443484296","cluster_addr":"172.21.15.142:6827/2443484296","heartbeat_back_addr":"172.21.15.142:6831/2443484296","heartbeat_front_addr":"172.21.15.142:6829/2443484296","state":["exists","up"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6809","nonce":1727563740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6811","nonce":1727563740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6815","nonce":1727563740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6813","nonce":1727563740}]},"public_addr":"172.21.15.175:6809/1727563740","cluster_addr":"172.21.15.175:6811/1727563740","heartbeat_back_addr":"172.21.15.175:6815/1727563740","heartbeat_front_addr":"172.21.15.175:6813/1727563740","state":["exists","up"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6820","nonce":652278083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6824","nonce":652278083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6832","nonce":652278083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6828","nonce":652278083}]},"public_addr":"172.21.15.59:6820/652278083","cluster_addr":"172.21.15.59:6824/652278083","heartbeat_back_addr":"172.21.15.59:6832/652278083","heartbeat_front_addr":"172.21.15.59:6828/652278083","state":["exists","up"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6802","nonce":1522341187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6806","nonce":1522341187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6820","nonce":1522341187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6812","nonce":1522341187}]},"public_addr":"172.21.15.136:6802/1522341187","cluster_addr":"172.21.15.136:6806/1522341187","heartbeat_back_addr":"172.21.15.136:6820/1522341187","heartbeat_front_addr":"172.21.15.136:6812/1522341187","state":["exists","up"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6810","nonce":2358058219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6813","nonce":2358058219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6819","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6820","nonce":2358058219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6815","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6817","nonce":2358058219}]},"public_addr":"172.21.15.142:6810/2358058219","cluster_addr":"172.21.15.142:6813/2358058219","heartbeat_back_addr":"172.21.15.142:6820/2358058219","heartbeat_front_addr":"172.21.15.142:6817/2358058219","state":["exists","up"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6825","nonce":3853198939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6827","nonce":3853198939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6831","nonce":3853198939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6829","nonce":3853198939}]},"public_addr":"172.21.15.175:6825/3853198939","cluster_addr":"172.21.15.175:6827/3853198939","heartbeat_back_addr":"172.21.15.175:6831/3853198939","heartbeat_front_addr":"172.21.15.175:6829/3853198939","state":["exists","up"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":24,"last_clean_end":106,"up_from":118,"up_thru":31,"down_at":107,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6811","nonce":2475559692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6813","nonce":2475559692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6817","nonce":2475559692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6815","nonce":2475559692}]},"public_addr":"172.21.15.59:6811/2475559692","cluster_addr":"172.21.15.59:6813/2475559692","heartbeat_back_addr":"172.21.15.59:6817/2475559692","heartbeat_front_addr":"172.21.15.59:6815/2475559692","state":["exists","up"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6803","nonce":2997471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6807","nonce":2997471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6822","nonce":2997471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6814","nonce":2997471095}]},"public_addr":"172.21.15.136:6803/2997471095","cluster_addr":"172.21.15.136:6807/2997471095","heartbeat_back_addr":"172.21.15.136:6822/2997471095","heartbeat_front_addr":"172.21.15.136:6814/2997471095","state":["exists","up"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":22,"last_clean_end":94,"up_from":115,"up_thru":115,"down_at":95,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6811","nonce":1330819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6816","nonce":1330819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6823","nonce":1330819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6821","nonce":1330819645}]},"public_addr":"172.21.15.142:6811/1330819645","cluster_addr":"172.21.15.142:6816/1330819645","heartbeat_back_addr":"172.21.15.142:6823/1330819645","heartbeat_front_addr":"172.21.15.142:6821/1330819645","state":["exists","up"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6817","nonce":1433451080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6819","nonce":1433451080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6823","nonce":1433451080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6821","nonce":1433451080}]},"public_addr":"172.21.15.175:6817/1433451080","cluster_addr":"172.21.15.175:6819/1433451080","heartbeat_back_addr":"172.21.15.175:6823/1433451080","heartbeat_front_addr":"172.21.15.175:6821/1433451080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:24:55.274534+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:54.964426+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:02.389817+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:14.926487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:17.830297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:02.217303+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.697164+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:15.603368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.115446+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:03.922985+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:11.660886+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:18.192320+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:14.230296+0000","dead_epoch":107},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:01.719519+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:33.819450+0000","dead_epoch":95},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:15.445311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":26,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":36,"length":4},{"begin":41,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:26:21.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T02:26:21.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T02:26:21.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T02:26:21.916 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T02:26:21.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T02:26:21.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T02:26:21.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T02:26:21.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T02:26:21.918 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-04-26T02:26:21.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-04-26T02:26:21.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-04-26T02:26:21.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-04-26T02:26:21.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2024-04-26T02:26:21.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2024-04-26T02:26:21.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2024-04-26T02:26:21.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2024-04-26T02:26:22.336 INFO:teuthology.orchestra.run.smithi059.stdout:493921239051 2024-04-26T02:26:22.336 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-04-26T02:26:22.343 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:22.343 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-04-26T02:26:22.380 INFO:teuthology.orchestra.run.smithi059.stdout:90194313250 2024-04-26T02:26:22.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T02:26:22.403 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:22.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-04-26T02:26:22.413 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:22.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2024-04-26T02:26:22.433 INFO:teuthology.orchestra.run.smithi059.stdout:94489280548 2024-04-26T02:26:22.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T02:26:22.443 INFO:teuthology.orchestra.run.smithi059.stdout:94489280548 2024-04-26T02:26:22.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T02:26:22.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-26T02:26:22.445+0000 7fa97e1d6640 0 --2- 172.21.15.59:0/1486578140 >> v2:172.21.15.59:3300/0 conn(0x7fa9781506a0 0x7fa978150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-04-26T02:26:22.452 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:22.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T02:26:22.458 INFO:teuthology.orchestra.run.smithi059.stdout:103079215138 2024-04-26T02:26:22.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-04-26T02:26:22.478 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:22.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-04-26T02:26:22.483 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:22.483 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T02:26:22.488 INFO:teuthology.orchestra.run.smithi059.stdout:506806140937 2024-04-26T02:26:22.488 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2024-04-26T02:26:22.492 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:22.492 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T02:26:22.507 INFO:teuthology.orchestra.run.smithi059.stdout:103079215138 2024-04-26T02:26:22.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T02:26:22.550 INFO:teuthology.orchestra.run.smithi059.stdout:103079215138 2024-04-26T02:26:22.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T02:26:22.574 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:22.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-04-26T02:26:23.173 INFO:teuthology.orchestra.run.smithi059.stdout:493921239050 2024-04-26T02:26:23.210 INFO:teuthology.orchestra.run.smithi059.stdout:94489280544 2024-04-26T02:26:23.229 INFO:tasks.ceph.ceph_manager.ceph:need seq 493921239051 got 493921239050 for osd.14 2024-04-26T02:26:23.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280546 got 94489280544 for osd.15 2024-04-26T02:26:23.260 INFO:teuthology.orchestra.run.smithi059.stdout:90194313249 2024-04-26T02:26:23.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313250 got 90194313249 for osd.3 2024-04-26T02:26:23.341 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:23.388 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:23.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280547 got 94489280547 for osd.13 2024-04-26T02:26:23.393 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.397 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:23.401 INFO:teuthology.orchestra.run.smithi059.stdout:506806140937 2024-04-26T02:26:23.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280546 got 94489280546 for osd.10 2024-04-26T02:26:23.434 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280547 got 94489280547 for osd.9 2024-04-26T02:26:23.445 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 506806140937 got 506806140937 for osd.12 2024-04-26T02:26:23.455 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.484 INFO:teuthology.orchestra.run.smithi059.stdout:94489280548 2024-04-26T02:26:23.486 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:23.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280547 got 94489280547 for osd.6 2024-04-26T02:26:23.513 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280548 got 94489280548 for osd.2 2024-04-26T02:26:23.525 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.539 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:23.543 INFO:teuthology.orchestra.run.smithi059.stdout:103079215138 2024-04-26T02:26:23.544 INFO:teuthology.orchestra.run.smithi059.stdout:94489280547 2024-04-26T02:26:23.545 INFO:teuthology.orchestra.run.smithi059.stdout:94489280548 2024-04-26T02:26:23.557 INFO:teuthology.orchestra.run.smithi059.stdout:103079215138 2024-04-26T02:26:23.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280548 got 94489280548 for osd.1 2024-04-26T02:26:23.572 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280546 got 94489280546 for osd.5 2024-04-26T02:26:23.575 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215138 got 103079215138 for osd.8 2024-04-26T02:26:23.578 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280547 got 94489280547 for osd.11 2024-04-26T02:26:23.582 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215138 got 103079215138 for osd.4 2024-04-26T02:26:23.589 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.597 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:23.611 INFO:teuthology.orchestra.run.smithi059.stdout:103079215138 2024-04-26T02:26:23.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280546 got 94489280546 for osd.7 2024-04-26T02:26:23.614 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:23.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215138 got 103079215138 for osd.0 2024-04-26T02:26:23.629 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:24.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2024-04-26T02:26:24.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2024-04-26T02:26:24.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T02:26:24.543 INFO:teuthology.orchestra.run.smithi059.stdout:493921239051 2024-04-26T02:26:24.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 493921239051 got 493921239051 for osd.14 2024-04-26T02:26:24.560 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:24.580 INFO:teuthology.orchestra.run.smithi059.stdout:94489280546 2024-04-26T02:26:24.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280546 got 94489280546 for osd.15 2024-04-26T02:26:24.598 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:24.609 INFO:teuthology.orchestra.run.smithi059.stdout:90194313250 2024-04-26T02:26:24.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313250 got 90194313250 for osd.3 2024-04-26T02:26:24.627 DEBUG:teuthology.parallel:result is None 2024-04-26T02:26:24.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T02:26:24.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:26:24.959 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:24.960 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:26:24.976 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-26T02:26:24.753758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":618176,"kb_used_data":36960,"kb_used_omap":43,"kb_used_meta":580884,"kb_avail":1509331264,"statfs":{"total":1546188226560,"available":1545555214336,"internally_reserved":0,"allocated":37847040,"data_stored":22763706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44860,"internal_metadata":594825412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.522017"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":471,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.626239+0000","last_change":"2024-04-26T02:26:12.841549+0000","last_active":"2024-04-26T02:26:21.626239+0000","last_peered":"2024-04-26T02:26:21.626239+0000","last_clean":"2024-04-26T02:26:21.626239+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:26:21.626239+0000","last_undegraded":"2024-04-26T02:26:21.626239+0000","last_fullsized":"2024-04-26T02:26:21.626239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-26T02:26:12.841309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:26:12.841309+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:38.599094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591318+0000","last_change":"2024-04-26T02:25:38.921583+0000","last_active":"2024-04-26T02:26:21.591318+0000","last_peered":"2024-04-26T02:26:21.591318+0000","last_clean":"2024-04-26T02:26:21.591318+0000","last_became_active":"2024-04-26T02:25:36.612717+0000","last_became_peered":"2024-04-26T02:25:36.612717+0000","last_unstale":"2024-04-26T02:26:21.591318+0000","last_undegraded":"2024-04-26T02:26:21.591318+0000","last_fullsized":"2024-04-26T02:26:21.591318+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:38.921358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:38.921358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:04.960324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":273,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276301+0000","last_change":"2024-04-26T02:26:20.756492+0000","last_active":"2024-04-26T02:26:23.276301+0000","last_peered":"2024-04-26T02:26:23.276301+0000","last_clean":"2024-04-26T02:26:23.276301+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:26:23.276301+0000","last_undegraded":"2024-04-26T02:26:23.276301+0000","last_fullsized":"2024-04-26T02:26:23.276301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_clean_scrub_stamp":"2024-04-26T02:26:20.756212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:23.090502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591337+0000","last_change":"2024-04-26T02:25:37.894246+0000","last_active":"2024-04-26T02:26:21.591337+0000","last_peered":"2024-04-26T02:26:21.591337+0000","last_clean":"2024-04-26T02:26:21.591337+0000","last_became_active":"2024-04-26T02:25:36.003450+0000","last_became_peered":"2024-04-26T02:25:36.003450+0000","last_unstale":"2024-04-26T02:26:21.591337+0000","last_undegraded":"2024-04-26T02:26:21.591337+0000","last_fullsized":"2024-04-26T02:26:21.591337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_clean_scrub_stamp":"2024-04-26T02:25:37.894136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:41.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276288+0000","last_change":"2024-04-26T02:25:18.339397+0000","last_active":"2024-04-26T02:26:23.276288+0000","last_peered":"2024-04-26T02:26:23.276288+0000","last_clean":"2024-04-26T02:26:23.276288+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:26:23.276288+0000","last_undegraded":"2024-04-26T02:26:23.276288+0000","last_fullsized":"2024-04-26T02:26:23.276288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:18.339173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:18.339173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-04-26T02:26:22.267500+0000","last_change":"2024-04-26T02:25:06.367563+0000","last_active":"2024-04-26T02:26:22.267500+0000","last_peered":"2024-04-26T02:26:22.267500+0000","last_clean":"2024-04-26T02:26:22.267500+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:26:22.267500+0000","last_undegraded":"2024-04-26T02:26:22.267500+0000","last_fullsized":"2024-04-26T02:26:22.267500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:06.367332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:06.367332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:22.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.593914+0000","last_change":"2024-04-26T02:25:19.627747+0000","last_active":"2024-04-26T02:26:21.593914+0000","last_peered":"2024-04-26T02:26:21.593914+0000","last_clean":"2024-04-26T02:26:21.593914+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:26:21.593914+0000","last_undegraded":"2024-04-26T02:26:21.593914+0000","last_fullsized":"2024-04-26T02:26:21.593914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:19.627517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:19.627517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.624199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591493+0000","last_change":"2024-04-26T02:25:23.007989+0000","last_active":"2024-04-26T02:26:21.591493+0000","last_peered":"2024-04-26T02:26:21.591493+0000","last_clean":"2024-04-26T02:26:21.591493+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:26:21.591493+0000","last_undegraded":"2024-04-26T02:26:21.591493+0000","last_fullsized":"2024-04-26T02:26:21.591493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:23.007761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:23.007761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:28.692750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276302+0000","last_change":"2024-04-26T02:25:09.329930+0000","last_active":"2024-04-26T02:26:23.276302+0000","last_peered":"2024-04-26T02:26:23.276302+0000","last_clean":"2024-04-26T02:26:23.276302+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:26:23.276302+0000","last_undegraded":"2024-04-26T02:26:23.276302+0000","last_fullsized":"2024-04-26T02:26:23.276302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:09.329781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:09.329781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:32.651765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":118,"seq":506806140938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31224,"kb_used_data":2272,"kb_used_omap":5,"kb_used_meta":28922,"kb_avail":94340616,"statfs":{"total":96636764160,"available":96604790784,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5407,"internal_metadata":29616865},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313250,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33432,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338408,"statfs":{"total":96636764160,"available":96602529792,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51476,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320364,"statfs":{"total":96636764160,"available":96584052736,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[0,1,2,3,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29284,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342556,"statfs":{"total":96636764160,"available":96606777344,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":115,"seq":493921239052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":2240,"kb_used_omap":16,"kb_used_meta":29551,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17125,"internal_metadata":30260507},"hb_peers":[0,1,2,4,5,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33424,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338416,"statfs":{"total":96636764160,"available":96602537984,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51472,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320368,"statfs":{"total":96636764160,"available":96584056832,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215139,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:26:24.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:26:25.268 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:25.269 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:26:25.287 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2024-04-26T02:26:24.753758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":618176,"kb_used_data":36960,"kb_used_omap":43,"kb_used_meta":580884,"kb_avail":1509331264,"statfs":{"total":1546188226560,"available":1545555214336,"internally_reserved":0,"allocated":37847040,"data_stored":22763706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44860,"internal_metadata":594825412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.522017"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":471,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.626239+0000","last_change":"2024-04-26T02:26:12.841549+0000","last_active":"2024-04-26T02:26:21.626239+0000","last_peered":"2024-04-26T02:26:21.626239+0000","last_clean":"2024-04-26T02:26:21.626239+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:26:21.626239+0000","last_undegraded":"2024-04-26T02:26:21.626239+0000","last_fullsized":"2024-04-26T02:26:21.626239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-26T02:26:12.841309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:26:12.841309+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:38.599094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591318+0000","last_change":"2024-04-26T02:25:38.921583+0000","last_active":"2024-04-26T02:26:21.591318+0000","last_peered":"2024-04-26T02:26:21.591318+0000","last_clean":"2024-04-26T02:26:21.591318+0000","last_became_active":"2024-04-26T02:25:36.612717+0000","last_became_peered":"2024-04-26T02:25:36.612717+0000","last_unstale":"2024-04-26T02:26:21.591318+0000","last_undegraded":"2024-04-26T02:26:21.591318+0000","last_fullsized":"2024-04-26T02:26:21.591318+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:38.921358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:38.921358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:04.960324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":273,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276301+0000","last_change":"2024-04-26T02:26:20.756492+0000","last_active":"2024-04-26T02:26:23.276301+0000","last_peered":"2024-04-26T02:26:23.276301+0000","last_clean":"2024-04-26T02:26:23.276301+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:26:23.276301+0000","last_undegraded":"2024-04-26T02:26:23.276301+0000","last_fullsized":"2024-04-26T02:26:23.276301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_clean_scrub_stamp":"2024-04-26T02:26:20.756212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:23.090502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591337+0000","last_change":"2024-04-26T02:25:37.894246+0000","last_active":"2024-04-26T02:26:21.591337+0000","last_peered":"2024-04-26T02:26:21.591337+0000","last_clean":"2024-04-26T02:26:21.591337+0000","last_became_active":"2024-04-26T02:25:36.003450+0000","last_became_peered":"2024-04-26T02:25:36.003450+0000","last_unstale":"2024-04-26T02:26:21.591337+0000","last_undegraded":"2024-04-26T02:26:21.591337+0000","last_fullsized":"2024-04-26T02:26:21.591337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_clean_scrub_stamp":"2024-04-26T02:25:37.894136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:41.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276288+0000","last_change":"2024-04-26T02:25:18.339397+0000","last_active":"2024-04-26T02:26:23.276288+0000","last_peered":"2024-04-26T02:26:23.276288+0000","last_clean":"2024-04-26T02:26:23.276288+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:26:23.276288+0000","last_undegraded":"2024-04-26T02:26:23.276288+0000","last_fullsized":"2024-04-26T02:26:23.276288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:18.339173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:18.339173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-04-26T02:26:22.267500+0000","last_change":"2024-04-26T02:25:06.367563+0000","last_active":"2024-04-26T02:26:22.267500+0000","last_peered":"2024-04-26T02:26:22.267500+0000","last_clean":"2024-04-26T02:26:22.267500+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:26:22.267500+0000","last_undegraded":"2024-04-26T02:26:22.267500+0000","last_fullsized":"2024-04-26T02:26:22.267500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:06.367332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:06.367332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:22.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.593914+0000","last_change":"2024-04-26T02:25:19.627747+0000","last_active":"2024-04-26T02:26:21.593914+0000","last_peered":"2024-04-26T02:26:21.593914+0000","last_clean":"2024-04-26T02:26:21.593914+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:26:21.593914+0000","last_undegraded":"2024-04-26T02:26:21.593914+0000","last_fullsized":"2024-04-26T02:26:21.593914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:19.627517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:19.627517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.624199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591493+0000","last_change":"2024-04-26T02:25:23.007989+0000","last_active":"2024-04-26T02:26:21.591493+0000","last_peered":"2024-04-26T02:26:21.591493+0000","last_clean":"2024-04-26T02:26:21.591493+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:26:21.591493+0000","last_undegraded":"2024-04-26T02:26:21.591493+0000","last_fullsized":"2024-04-26T02:26:21.591493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:23.007761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:23.007761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:28.692750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276302+0000","last_change":"2024-04-26T02:25:09.329930+0000","last_active":"2024-04-26T02:26:23.276302+0000","last_peered":"2024-04-26T02:26:23.276302+0000","last_clean":"2024-04-26T02:26:23.276302+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:26:23.276302+0000","last_undegraded":"2024-04-26T02:26:23.276302+0000","last_fullsized":"2024-04-26T02:26:23.276302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:09.329781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:09.329781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:32.651765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":118,"seq":506806140938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31224,"kb_used_data":2272,"kb_used_omap":5,"kb_used_meta":28922,"kb_avail":94340616,"statfs":{"total":96636764160,"available":96604790784,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5407,"internal_metadata":29616865},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313250,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33432,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338408,"statfs":{"total":96636764160,"available":96602529792,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51476,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320364,"statfs":{"total":96636764160,"available":96584052736,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[0,1,2,3,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29284,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342556,"statfs":{"total":96636764160,"available":96606777344,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":115,"seq":493921239052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":2240,"kb_used_omap":16,"kb_used_meta":29551,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17125,"internal_metadata":30260507},"hb_peers":[0,1,2,4,5,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33424,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338416,"statfs":{"total":96636764160,"available":96602537984,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51472,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320368,"statfs":{"total":96636764160,"available":96584056832,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215139,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:26:25.288 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T02:26:25.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T02:26:25.594 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T02:26:25.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T02:26:25.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:26:25.881 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:25.881 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:26:25.899 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-04-26T02:26:25.276543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":618200,"kb_used_data":36992,"kb_used_omap":43,"kb_used_meta":580884,"kb_avail":1509331240,"statfs":{"total":1546188226560,"available":1545555189760,"internally_reserved":0,"allocated":37879808,"data_stored":22783140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44860,"internal_metadata":594825412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.523828"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":471,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.626239+0000","last_change":"2024-04-26T02:26:12.841549+0000","last_active":"2024-04-26T02:26:21.626239+0000","last_peered":"2024-04-26T02:26:21.626239+0000","last_clean":"2024-04-26T02:26:21.626239+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:26:21.626239+0000","last_undegraded":"2024-04-26T02:26:21.626239+0000","last_fullsized":"2024-04-26T02:26:21.626239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-26T02:26:12.841309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:26:12.841309+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:38.599094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591318+0000","last_change":"2024-04-26T02:25:38.921583+0000","last_active":"2024-04-26T02:26:21.591318+0000","last_peered":"2024-04-26T02:26:21.591318+0000","last_clean":"2024-04-26T02:26:21.591318+0000","last_became_active":"2024-04-26T02:25:36.612717+0000","last_became_peered":"2024-04-26T02:25:36.612717+0000","last_unstale":"2024-04-26T02:26:21.591318+0000","last_undegraded":"2024-04-26T02:26:21.591318+0000","last_fullsized":"2024-04-26T02:26:21.591318+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:38.921358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:38.921358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:04.960324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":273,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276301+0000","last_change":"2024-04-26T02:26:20.756492+0000","last_active":"2024-04-26T02:26:23.276301+0000","last_peered":"2024-04-26T02:26:23.276301+0000","last_clean":"2024-04-26T02:26:23.276301+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:26:23.276301+0000","last_undegraded":"2024-04-26T02:26:23.276301+0000","last_fullsized":"2024-04-26T02:26:23.276301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_clean_scrub_stamp":"2024-04-26T02:26:20.756212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:23.090502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591337+0000","last_change":"2024-04-26T02:25:37.894246+0000","last_active":"2024-04-26T02:26:21.591337+0000","last_peered":"2024-04-26T02:26:21.591337+0000","last_clean":"2024-04-26T02:26:21.591337+0000","last_became_active":"2024-04-26T02:25:36.003450+0000","last_became_peered":"2024-04-26T02:25:36.003450+0000","last_unstale":"2024-04-26T02:26:21.591337+0000","last_undegraded":"2024-04-26T02:26:21.591337+0000","last_fullsized":"2024-04-26T02:26:21.591337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_clean_scrub_stamp":"2024-04-26T02:25:37.894136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:41.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276288+0000","last_change":"2024-04-26T02:25:18.339397+0000","last_active":"2024-04-26T02:26:23.276288+0000","last_peered":"2024-04-26T02:26:23.276288+0000","last_clean":"2024-04-26T02:26:23.276288+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:26:23.276288+0000","last_undegraded":"2024-04-26T02:26:23.276288+0000","last_fullsized":"2024-04-26T02:26:23.276288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:18.339173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:18.339173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-04-26T02:26:22.267500+0000","last_change":"2024-04-26T02:25:06.367563+0000","last_active":"2024-04-26T02:26:22.267500+0000","last_peered":"2024-04-26T02:26:22.267500+0000","last_clean":"2024-04-26T02:26:22.267500+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:26:22.267500+0000","last_undegraded":"2024-04-26T02:26:22.267500+0000","last_fullsized":"2024-04-26T02:26:22.267500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:06.367332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:06.367332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:22.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.593914+0000","last_change":"2024-04-26T02:25:19.627747+0000","last_active":"2024-04-26T02:26:21.593914+0000","last_peered":"2024-04-26T02:26:21.593914+0000","last_clean":"2024-04-26T02:26:21.593914+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:26:21.593914+0000","last_undegraded":"2024-04-26T02:26:21.593914+0000","last_fullsized":"2024-04-26T02:26:21.593914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:19.627517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:19.627517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.624199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591493+0000","last_change":"2024-04-26T02:25:23.007989+0000","last_active":"2024-04-26T02:26:21.591493+0000","last_peered":"2024-04-26T02:26:21.591493+0000","last_clean":"2024-04-26T02:26:21.591493+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:26:21.591493+0000","last_undegraded":"2024-04-26T02:26:21.591493+0000","last_fullsized":"2024-04-26T02:26:21.591493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:23.007761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:23.007761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:28.692750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276302+0000","last_change":"2024-04-26T02:25:09.329930+0000","last_active":"2024-04-26T02:26:23.276302+0000","last_peered":"2024-04-26T02:26:23.276302+0000","last_clean":"2024-04-26T02:26:23.276302+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:26:23.276302+0000","last_undegraded":"2024-04-26T02:26:23.276302+0000","last_fullsized":"2024-04-26T02:26:23.276302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:09.329781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:09.329781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:32.651765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":118,"seq":506806140938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31224,"kb_used_data":2272,"kb_used_omap":5,"kb_used_meta":28922,"kb_avail":94340616,"statfs":{"total":96636764160,"available":96604790784,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5407,"internal_metadata":29616865},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313251,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33456,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338384,"statfs":{"total":96636764160,"available":96602505216,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51476,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320364,"statfs":{"total":96636764160,"available":96584052736,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[0,1,2,3,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29284,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342556,"statfs":{"total":96636764160,"available":96606777344,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":115,"seq":493921239052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":2240,"kb_used_omap":16,"kb_used_meta":29551,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17125,"internal_metadata":30260507},"hb_peers":[0,1,2,4,5,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33424,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338416,"statfs":{"total":96636764160,"available":96602537984,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51472,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320368,"statfs":{"total":96636764160,"available":96584056832,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215139,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:26:25.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:26:26.200 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:26.200 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:26:26.219 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-04-26T02:26:25.276543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":618200,"kb_used_data":36992,"kb_used_omap":43,"kb_used_meta":580884,"kb_avail":1509331240,"statfs":{"total":1546188226560,"available":1545555189760,"internally_reserved":0,"allocated":37879808,"data_stored":22783140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44860,"internal_metadata":594825412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.523828"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":471,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.626239+0000","last_change":"2024-04-26T02:26:12.841549+0000","last_active":"2024-04-26T02:26:21.626239+0000","last_peered":"2024-04-26T02:26:21.626239+0000","last_clean":"2024-04-26T02:26:21.626239+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:26:21.626239+0000","last_undegraded":"2024-04-26T02:26:21.626239+0000","last_fullsized":"2024-04-26T02:26:21.626239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-26T02:26:12.841309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:26:12.841309+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:38.599094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591318+0000","last_change":"2024-04-26T02:25:38.921583+0000","last_active":"2024-04-26T02:26:21.591318+0000","last_peered":"2024-04-26T02:26:21.591318+0000","last_clean":"2024-04-26T02:26:21.591318+0000","last_became_active":"2024-04-26T02:25:36.612717+0000","last_became_peered":"2024-04-26T02:25:36.612717+0000","last_unstale":"2024-04-26T02:26:21.591318+0000","last_undegraded":"2024-04-26T02:26:21.591318+0000","last_fullsized":"2024-04-26T02:26:21.591318+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:38.921358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:38.921358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:04.960324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":273,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276301+0000","last_change":"2024-04-26T02:26:20.756492+0000","last_active":"2024-04-26T02:26:23.276301+0000","last_peered":"2024-04-26T02:26:23.276301+0000","last_clean":"2024-04-26T02:26:23.276301+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:26:23.276301+0000","last_undegraded":"2024-04-26T02:26:23.276301+0000","last_fullsized":"2024-04-26T02:26:23.276301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_clean_scrub_stamp":"2024-04-26T02:26:20.756212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:23.090502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591337+0000","last_change":"2024-04-26T02:25:37.894246+0000","last_active":"2024-04-26T02:26:21.591337+0000","last_peered":"2024-04-26T02:26:21.591337+0000","last_clean":"2024-04-26T02:26:21.591337+0000","last_became_active":"2024-04-26T02:25:36.003450+0000","last_became_peered":"2024-04-26T02:25:36.003450+0000","last_unstale":"2024-04-26T02:26:21.591337+0000","last_undegraded":"2024-04-26T02:26:21.591337+0000","last_fullsized":"2024-04-26T02:26:21.591337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_clean_scrub_stamp":"2024-04-26T02:25:37.894136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:41.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276288+0000","last_change":"2024-04-26T02:25:18.339397+0000","last_active":"2024-04-26T02:26:23.276288+0000","last_peered":"2024-04-26T02:26:23.276288+0000","last_clean":"2024-04-26T02:26:23.276288+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:26:23.276288+0000","last_undegraded":"2024-04-26T02:26:23.276288+0000","last_fullsized":"2024-04-26T02:26:23.276288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:18.339173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:18.339173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-04-26T02:26:22.267500+0000","last_change":"2024-04-26T02:25:06.367563+0000","last_active":"2024-04-26T02:26:22.267500+0000","last_peered":"2024-04-26T02:26:22.267500+0000","last_clean":"2024-04-26T02:26:22.267500+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:26:22.267500+0000","last_undegraded":"2024-04-26T02:26:22.267500+0000","last_fullsized":"2024-04-26T02:26:22.267500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:06.367332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:06.367332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:22.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.593914+0000","last_change":"2024-04-26T02:25:19.627747+0000","last_active":"2024-04-26T02:26:21.593914+0000","last_peered":"2024-04-26T02:26:21.593914+0000","last_clean":"2024-04-26T02:26:21.593914+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:26:21.593914+0000","last_undegraded":"2024-04-26T02:26:21.593914+0000","last_fullsized":"2024-04-26T02:26:21.593914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:19.627517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:19.627517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.624199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591493+0000","last_change":"2024-04-26T02:25:23.007989+0000","last_active":"2024-04-26T02:26:21.591493+0000","last_peered":"2024-04-26T02:26:21.591493+0000","last_clean":"2024-04-26T02:26:21.591493+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:26:21.591493+0000","last_undegraded":"2024-04-26T02:26:21.591493+0000","last_fullsized":"2024-04-26T02:26:21.591493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:23.007761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:23.007761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:28.692750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276302+0000","last_change":"2024-04-26T02:25:09.329930+0000","last_active":"2024-04-26T02:26:23.276302+0000","last_peered":"2024-04-26T02:26:23.276302+0000","last_clean":"2024-04-26T02:26:23.276302+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:26:23.276302+0000","last_undegraded":"2024-04-26T02:26:23.276302+0000","last_fullsized":"2024-04-26T02:26:23.276302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:09.329781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:09.329781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:32.651765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":118,"seq":506806140938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31224,"kb_used_data":2272,"kb_used_omap":5,"kb_used_meta":28922,"kb_avail":94340616,"statfs":{"total":96636764160,"available":96604790784,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5407,"internal_metadata":29616865},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313251,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33456,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338384,"statfs":{"total":96636764160,"available":96602505216,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51476,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320364,"statfs":{"total":96636764160,"available":96584052736,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[0,1,2,3,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29284,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342556,"statfs":{"total":96636764160,"available":96606777344,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":115,"seq":493921239052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":2240,"kb_used_omap":16,"kb_used_meta":29551,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17125,"internal_metadata":30260507},"hb_peers":[0,1,2,4,5,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33424,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338416,"statfs":{"total":96636764160,"available":96602537984,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51472,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320368,"statfs":{"total":96636764160,"available":96584056832,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215139,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:26:26.220 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T02:26:26.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:26:26.516 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:26.574 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:26:26.575 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-04-26T02:26:25.276543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":618200,"kb_used_data":36992,"kb_used_omap":43,"kb_used_meta":580884,"kb_avail":1509331240,"statfs":{"total":1546188226560,"available":1545555189760,"internally_reserved":0,"allocated":37879808,"data_stored":22783140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44860,"internal_metadata":594825412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.523828"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":471,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.626239+0000","last_change":"2024-04-26T02:26:12.841549+0000","last_active":"2024-04-26T02:26:21.626239+0000","last_peered":"2024-04-26T02:26:21.626239+0000","last_clean":"2024-04-26T02:26:21.626239+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:26:21.626239+0000","last_undegraded":"2024-04-26T02:26:21.626239+0000","last_fullsized":"2024-04-26T02:26:21.626239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-26T02:26:12.841309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:26:12.841309+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:38.599094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":82,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591318+0000","last_change":"2024-04-26T02:25:38.921583+0000","last_active":"2024-04-26T02:26:21.591318+0000","last_peered":"2024-04-26T02:26:21.591318+0000","last_clean":"2024-04-26T02:26:21.591318+0000","last_became_active":"2024-04-26T02:25:36.612717+0000","last_became_peered":"2024-04-26T02:25:36.612717+0000","last_unstale":"2024-04-26T02:26:21.591318+0000","last_undegraded":"2024-04-26T02:26:21.591318+0000","last_fullsized":"2024-04-26T02:26:21.591318+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:38.921358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:38.921358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:04.960324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":273,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276301+0000","last_change":"2024-04-26T02:26:20.756492+0000","last_active":"2024-04-26T02:26:23.276301+0000","last_peered":"2024-04-26T02:26:23.276301+0000","last_clean":"2024-04-26T02:26:23.276301+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:26:23.276301+0000","last_undegraded":"2024-04-26T02:26:23.276301+0000","last_fullsized":"2024-04-26T02:26:23.276301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:20.756212+0000","last_clean_scrub_stamp":"2024-04-26T02:26:20.756212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:23.090502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591337+0000","last_change":"2024-04-26T02:25:37.894246+0000","last_active":"2024-04-26T02:26:21.591337+0000","last_peered":"2024-04-26T02:26:21.591337+0000","last_clean":"2024-04-26T02:26:21.591337+0000","last_became_active":"2024-04-26T02:25:36.003450+0000","last_became_peered":"2024-04-26T02:25:36.003450+0000","last_unstale":"2024-04-26T02:26:21.591337+0000","last_undegraded":"2024-04-26T02:26:21.591337+0000","last_fullsized":"2024-04-26T02:26:21.591337+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_clean_scrub_stamp":"2024-04-26T02:25:37.894136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:41.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276288+0000","last_change":"2024-04-26T02:25:18.339397+0000","last_active":"2024-04-26T02:26:23.276288+0000","last_peered":"2024-04-26T02:26:23.276288+0000","last_clean":"2024-04-26T02:26:23.276288+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:26:23.276288+0000","last_undegraded":"2024-04-26T02:26:23.276288+0000","last_fullsized":"2024-04-26T02:26:23.276288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:18.339173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:18.339173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.941308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":263,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-04-26T02:26:22.267500+0000","last_change":"2024-04-26T02:25:06.367563+0000","last_active":"2024-04-26T02:26:22.267500+0000","last_peered":"2024-04-26T02:26:22.267500+0000","last_clean":"2024-04-26T02:26:22.267500+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:26:22.267500+0000","last_undegraded":"2024-04-26T02:26:22.267500+0000","last_fullsized":"2024-04-26T02:26:22.267500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:06.367332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:06.367332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:22.671174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.593914+0000","last_change":"2024-04-26T02:25:19.627747+0000","last_active":"2024-04-26T02:26:21.593914+0000","last_peered":"2024-04-26T02:26:21.593914+0000","last_clean":"2024-04-26T02:26:21.593914+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:26:21.593914+0000","last_undegraded":"2024-04-26T02:26:21.593914+0000","last_fullsized":"2024-04-26T02:26:21.593914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:19.627517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:19.627517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:27.624199+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-26T02:26:21.591493+0000","last_change":"2024-04-26T02:25:23.007989+0000","last_active":"2024-04-26T02:26:21.591493+0000","last_peered":"2024-04-26T02:26:21.591493+0000","last_clean":"2024-04-26T02:26:21.591493+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:26:21.591493+0000","last_undegraded":"2024-04-26T02:26:21.591493+0000","last_fullsized":"2024-04-26T02:26:21.591493+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:23.007761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:23.007761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:28.692750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":265,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-04-26T02:26:23.276302+0000","last_change":"2024-04-26T02:25:09.329930+0000","last_active":"2024-04-26T02:26:23.276302+0000","last_peered":"2024-04-26T02:26:23.276302+0000","last_clean":"2024-04-26T02:26:23.276302+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:26:23.276302+0000","last_undegraded":"2024-04-26T02:26:23.276302+0000","last_fullsized":"2024-04-26T02:26:23.276302+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:09.329781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:09.329781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:32.651765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":118,"seq":506806140938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31224,"kb_used_data":2272,"kb_used_omap":5,"kb_used_meta":28922,"kb_avail":94340616,"statfs":{"total":96636764160,"available":96604790784,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5407,"internal_metadata":29616865},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215139,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51504,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320336,"statfs":{"total":96636764160,"available":96584024064,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313251,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33456,"kb_used_data":2272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338384,"statfs":{"total":96636764160,"available":96602505216,"internally_reserved":0,"allocated":2326528,"data_stored":1373000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280546,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51476,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320364,"statfs":{"total":96636764160,"available":96584052736,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[0,1,2,3,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29284,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342556,"statfs":{"total":96636764160,"available":96606777344,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":115,"seq":493921239052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":2240,"kb_used_omap":16,"kb_used_meta":29551,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17125,"internal_metadata":30260507},"hb_peers":[0,1,2,4,5,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280548,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33408,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338432,"statfs":{"total":96636764160,"available":96602554368,"internally_reserved":0,"allocated":2277376,"data_stored":1343916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33948,"kb_used_data":2760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337892,"statfs":{"total":96636764160,"available":96602001408,"internally_reserved":0,"allocated":2826240,"data_stored":1882494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280546,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33424,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338416,"statfs":{"total":96636764160,"available":96602537984,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33428,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338412,"statfs":{"total":96636764160,"available":96602533888,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280547,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51472,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320368,"statfs":{"total":96636764160,"available":96584056832,"internally_reserved":0,"allocated":2293760,"data_stored":1353566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215139,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51484,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320356,"statfs":{"total":96636764160,"available":96584044544,"internally_reserved":0,"allocated":2310144,"data_stored":1363308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:26:26.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T02:26:26.875 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:26.875 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":153,"fsid":"83ecef7b-067c-41a4-8f83-dfa16b8b2690","created":"2024-04-26T02:23:33.724500+0000","modified":"2024-04-26T02:26:25.274076+0000","last_up_change":"2024-04-26T02:25:48.908541+0000","last_in_change":"2024-04-26T02:25:48.908541+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T02:23:46.791952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T02:23:48.950495+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9499998092651367,"score_stable":5.9499998092651367,"optimal_score":0.62999999523162842,"raw_score_acting":3.75,"raw_score_stable":3.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"393355f7-165c-4b50-a42c-211810b715e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6803","nonce":2847130092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6805","nonce":2847130092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6809","nonce":2847130092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":2847130092},{"type":"v1","addr":"172.21.15.59:6807","nonce":2847130092}]},"public_addr":"172.21.15.59:6803/2847130092","cluster_addr":"172.21.15.59:6805/2847130092","heartbeat_back_addr":"172.21.15.59:6809/2847130092","heartbeat_front_addr":"172.21.15.59:6807/2847130092","state":["exists","up"]},{"osd":1,"uuid":"b2c35012-83a0-41ad-af28-9b6c78c491e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6809","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6813","nonce":504096392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6817","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6821","nonce":504096392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6829","nonce":504096392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":504096392},{"type":"v1","addr":"172.21.15.136:6826","nonce":504096392}]},"public_addr":"172.21.15.136:6813/504096392","cluster_addr":"172.21.15.136:6821/504096392","heartbeat_back_addr":"172.21.15.136:6829/504096392","heartbeat_front_addr":"172.21.15.136:6826/504096392","state":["exists","up"]},{"osd":2,"uuid":"5d88e67c-1ca1-4660-9cab-a609fce99a51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6801","nonce":785558131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6803","nonce":785558131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6807","nonce":785558131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":785558131},{"type":"v1","addr":"172.21.15.142:6805","nonce":785558131}]},"public_addr":"172.21.15.142:6801/785558131","cluster_addr":"172.21.15.142:6803/785558131","heartbeat_back_addr":"172.21.15.142:6807/785558131","heartbeat_front_addr":"172.21.15.142:6805/785558131","state":["exists","up"]},{"osd":3,"uuid":"47b1c97a-90b1-4cf5-ad48-2a413f2469bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6801","nonce":3691596427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6803","nonce":3691596427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6807","nonce":3691596427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":3691596427},{"type":"v1","addr":"172.21.15.175:6805","nonce":3691596427}]},"public_addr":"172.21.15.175:6801/3691596427","cluster_addr":"172.21.15.175:6803/3691596427","heartbeat_back_addr":"172.21.15.175:6807/3691596427","heartbeat_front_addr":"172.21.15.175:6805/3691596427","state":["exists","up"]},{"osd":4,"uuid":"ae142bca-645a-48c1-ab55-d439ba3354e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6821","nonce":2291404497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6823","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6825","nonce":2291404497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6831","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6833","nonce":2291404497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6827","nonce":2291404497},{"type":"v1","addr":"172.21.15.59:6829","nonce":2291404497}]},"public_addr":"172.21.15.59:6821/2291404497","cluster_addr":"172.21.15.59:6825/2291404497","heartbeat_back_addr":"172.21.15.59:6833/2291404497","heartbeat_front_addr":"172.21.15.59:6829/2291404497","state":["exists","up"]},{"osd":5,"uuid":"a1842799-b72b-4931-a839-253ac1b292d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6815","nonce":3420144978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6819","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6823","nonce":3420144978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6831","nonce":3420144978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6825","nonce":3420144978},{"type":"v1","addr":"172.21.15.136:6827","nonce":3420144978}]},"public_addr":"172.21.15.136:6815/3420144978","cluster_addr":"172.21.15.136:6823/3420144978","heartbeat_back_addr":"172.21.15.136:6831/3420144978","heartbeat_front_addr":"172.21.15.136:6827/3420144978","state":["exists","up"]},{"osd":6,"uuid":"8281f789-0853-4359-8aaa-c9ec5795fd51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6825","nonce":2443484296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6827","nonce":2443484296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6831","nonce":2443484296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":2443484296},{"type":"v1","addr":"172.21.15.142:6829","nonce":2443484296}]},"public_addr":"172.21.15.142:6825/2443484296","cluster_addr":"172.21.15.142:6827/2443484296","heartbeat_back_addr":"172.21.15.142:6831/2443484296","heartbeat_front_addr":"172.21.15.142:6829/2443484296","state":["exists","up"]},{"osd":7,"uuid":"6c4063c6-1df9-4fb7-b29e-cdbebf121e3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6809","nonce":1727563740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6811","nonce":1727563740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6815","nonce":1727563740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1727563740},{"type":"v1","addr":"172.21.15.175:6813","nonce":1727563740}]},"public_addr":"172.21.15.175:6809/1727563740","cluster_addr":"172.21.15.175:6811/1727563740","heartbeat_back_addr":"172.21.15.175:6815/1727563740","heartbeat_front_addr":"172.21.15.175:6813/1727563740","state":["exists","up"]},{"osd":8,"uuid":"0b87d6f6-ee22-4c0b-83f7-2e97682943be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6820","nonce":652278083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6824","nonce":652278083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6832","nonce":652278083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":652278083},{"type":"v1","addr":"172.21.15.59:6828","nonce":652278083}]},"public_addr":"172.21.15.59:6820/652278083","cluster_addr":"172.21.15.59:6824/652278083","heartbeat_back_addr":"172.21.15.59:6832/652278083","heartbeat_front_addr":"172.21.15.59:6828/652278083","state":["exists","up"]},{"osd":9,"uuid":"fca5962a-8f15-4b46-a0be-570fa8cdb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6802","nonce":1522341187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6806","nonce":1522341187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6820","nonce":1522341187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1522341187},{"type":"v1","addr":"172.21.15.136:6812","nonce":1522341187}]},"public_addr":"172.21.15.136:6802/1522341187","cluster_addr":"172.21.15.136:6806/1522341187","heartbeat_back_addr":"172.21.15.136:6820/1522341187","heartbeat_front_addr":"172.21.15.136:6812/1522341187","state":["exists","up"]},{"osd":10,"uuid":"f2482c62-a013-4dfa-9270-e0d7163d8f3b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6810","nonce":2358058219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6813","nonce":2358058219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6819","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6820","nonce":2358058219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6815","nonce":2358058219},{"type":"v1","addr":"172.21.15.142:6817","nonce":2358058219}]},"public_addr":"172.21.15.142:6810/2358058219","cluster_addr":"172.21.15.142:6813/2358058219","heartbeat_back_addr":"172.21.15.142:6820/2358058219","heartbeat_front_addr":"172.21.15.142:6817/2358058219","state":["exists","up"]},{"osd":11,"uuid":"c45ddf84-c385-4e2b-bc77-cc9a29dbee0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6825","nonce":3853198939}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6827","nonce":3853198939}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6831","nonce":3853198939}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":3853198939},{"type":"v1","addr":"172.21.15.175:6829","nonce":3853198939}]},"public_addr":"172.21.15.175:6825/3853198939","cluster_addr":"172.21.15.175:6827/3853198939","heartbeat_back_addr":"172.21.15.175:6831/3853198939","heartbeat_front_addr":"172.21.15.175:6829/3853198939","state":["exists","up"]},{"osd":12,"uuid":"3ee52abb-eca5-4fd9-b1b3-9d9cf5db63a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":24,"last_clean_end":106,"up_from":118,"up_thru":31,"down_at":107,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6811","nonce":2475559692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6813","nonce":2475559692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6817","nonce":2475559692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":2475559692},{"type":"v1","addr":"172.21.15.59:6815","nonce":2475559692}]},"public_addr":"172.21.15.59:6811/2475559692","cluster_addr":"172.21.15.59:6813/2475559692","heartbeat_back_addr":"172.21.15.59:6817/2475559692","heartbeat_front_addr":"172.21.15.59:6815/2475559692","state":["exists","up"]},{"osd":13,"uuid":"b118541d-aac5-4ead-b469-142e5041a0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6801","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6803","nonce":2997471095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6805","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6807","nonce":2997471095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6822","nonce":2997471095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6811","nonce":2997471095},{"type":"v1","addr":"172.21.15.136:6814","nonce":2997471095}]},"public_addr":"172.21.15.136:6803/2997471095","cluster_addr":"172.21.15.136:6807/2997471095","heartbeat_back_addr":"172.21.15.136:6822/2997471095","heartbeat_front_addr":"172.21.15.136:6814/2997471095","state":["exists","up"]},{"osd":14,"uuid":"328780ca-719f-400f-ab8a-d74dd2e68111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":22,"last_clean_end":94,"up_from":115,"up_thru":115,"down_at":95,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6809","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6811","nonce":1330819645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6816","nonce":1330819645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6823","nonce":1330819645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":1330819645},{"type":"v1","addr":"172.21.15.142:6821","nonce":1330819645}]},"public_addr":"172.21.15.142:6811/1330819645","cluster_addr":"172.21.15.142:6816/1330819645","heartbeat_back_addr":"172.21.15.142:6823/1330819645","heartbeat_front_addr":"172.21.15.142:6821/1330819645","state":["exists","up"]},{"osd":15,"uuid":"9bfe9d05-2d08-44e2-9eda-04d63f3cdf96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6817","nonce":1433451080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6819","nonce":1433451080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6823","nonce":1433451080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":1433451080},{"type":"v1","addr":"172.21.15.175:6821","nonce":1433451080}]},"public_addr":"172.21.15.175:6817/1433451080","cluster_addr":"172.21.15.175:6819/1433451080","heartbeat_back_addr":"172.21.15.175:6823/1433451080","heartbeat_front_addr":"172.21.15.175:6821/1433451080","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:22.271411+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:54.964426+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:24.811128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:14.926487+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:17.830297+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:02.217303+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:04.697164+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:15.603368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:22.112237+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:22.189281+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:11.660886+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:18.192320+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:14.230296+0000","dead_epoch":107},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:01.719519+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:25:33.819450+0000","dead_epoch":95},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T02:26:15.445311+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"shecprofile":{"c":"2","crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","k":"4","m":"3","name":"shecprofile","plugin":"shec","technique":"multiple"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":26,"length":1},{"begin":29,"length":1},{"begin":31,"length":1},{"begin":36,"length":4},{"begin":41,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T02:26:27.893 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T02:26:27.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:28.062 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:28.062 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:28.062 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:28.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T02:26:28.367 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T02:26:28.385 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T02:26:28.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:28.530 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:28.530 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:28.530 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:28.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T02:26:28.830 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T02:26:28.848 INFO:tasks.ceph:Scrubbing osd.8 2024-04-26T02:26:28.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:28.990 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:28.990 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:28.990 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:29.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-04-26T02:26:29.293 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 8 to deep-scrub 2024-04-26T02:26:29.312 INFO:tasks.ceph:Scrubbing osd.12 2024-04-26T02:26:29.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:29.473 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:29.473 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T02:26:29.474 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:29.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2024-04-26T02:26:29.787 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 12 to deep-scrub 2024-04-26T02:26:29.807 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T02:26:29.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:29.963 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:29.963 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:29.963 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:29.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T02:26:30.267 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T02:26:30.286 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T02:26:30.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:30.438 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:30.438 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:30.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T02:26:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T02:26:30.766 INFO:tasks.ceph:Scrubbing osd.9 2024-04-26T02:26:30.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:31.125 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:31.125 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:31.125 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:31.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-04-26T02:26:31.460 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 9 to deep-scrub 2024-04-26T02:26:31.480 INFO:tasks.ceph:Scrubbing osd.13 2024-04-26T02:26:31.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:31.639 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:31.639 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:31.639 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:31.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2024-04-26T02:26:31.950 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 13 to deep-scrub 2024-04-26T02:26:31.968 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T02:26:31.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:32.123 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:32.123 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:32.123 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:32.139 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T02:26:32.436 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T02:26:32.453 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T02:26:32.453 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:32.611 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:32.611 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:32.611 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:32.627 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T02:26:32.921 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T02:26:32.939 INFO:tasks.ceph:Scrubbing osd.10 2024-04-26T02:26:32.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:33.093 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:33.093 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:33.093 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:33.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-04-26T02:26:33.391 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 10 to deep-scrub 2024-04-26T02:26:33.408 INFO:tasks.ceph:Scrubbing osd.14 2024-04-26T02:26:33.409 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:33.566 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:33.567 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:33.567 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:33.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2024-04-26T02:26:33.864 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 14 to deep-scrub 2024-04-26T02:26:33.883 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T02:26:33.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:34.242 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:34.242 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:34.242 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:34.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T02:26:34.576 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T02:26:34.594 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T02:26:34.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:34.746 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:34.746 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:34.746 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:34.761 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T02:26:35.086 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T02:26:35.106 INFO:tasks.ceph:Scrubbing osd.11 2024-04-26T02:26:35.106 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:35.256 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:35.257 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:35.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-04-26T02:26:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 11 to deep-scrub 2024-04-26T02:26:36.420 INFO:tasks.ceph:Scrubbing osd.15 2024-04-26T02:26:36.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2024-04-26T02:26:36.576 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-26T02:26:36.576 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T02:26:36.576 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-26T02:26:36.593 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2024-04-26T02:26:36.881 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 15 to deep-scrub 2024-04-26T02:26:36.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:26:37.186 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:37.186 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:26:37.203 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-26T02:26:36.756343+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":619060,"kb_used_data":37904,"kb_used_omap":43,"kb_used_meta":580884,"kb_avail":1509330380,"statfs":{"total":1546188226560,"available":1545554309120,"internally_reserved":0,"allocated":38813696,"data_stored":23336000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44860,"internal_metadata":594825412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002190"},"pg_stats":[{"pgid":"1.0","version":"26'157","reported_seq":479,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:27.918680+0000","last_change":"2024-04-26T02:26:12.841549+0000","last_active":"2024-04-26T02:26:27.918680+0000","last_peered":"2024-04-26T02:26:27.918680+0000","last_clean":"2024-04-26T02:26:27.918680+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:26:27.918680+0000","last_undegraded":"2024-04-26T02:26:27.918680+0000","last_fullsized":"2024-04-26T02:26:27.918680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'157","last_scrub_stamp":"2024-04-26T02:26:12.841309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:46.869793+0000","last_clean_scrub_stamp":"2024-04-26T02:26:12.841309+0000","objects_scrubbed":2,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:38.599094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":90,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:27.918715+0000","last_change":"2024-04-26T02:25:38.921583+0000","last_active":"2024-04-26T02:26:27.918715+0000","last_peered":"2024-04-26T02:26:27.918715+0000","last_clean":"2024-04-26T02:26:27.918715+0000","last_became_active":"2024-04-26T02:25:36.612717+0000","last_became_peered":"2024-04-26T02:25:36.612717+0000","last_unstale":"2024-04-26T02:26:27.918715+0000","last_undegraded":"2024-04-26T02:26:27.918715+0000","last_fullsized":"2024-04-26T02:26:27.918715+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:38.921358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:25:38.921358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:04.960324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:31.792461+0000","last_change":"2024-04-26T02:26:31.792499+0000","last_active":"2024-04-26T02:26:31.792461+0000","last_peered":"2024-04-26T02:26:31.792461+0000","last_clean":"2024-04-26T02:26:31.792461+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:26:31.792461+0000","last_undegraded":"2024-04-26T02:26:31.792461+0000","last_fullsized":"2024-04-26T02:26:31.792461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:31.792378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:31.792378+0000","last_clean_scrub_stamp":"2024-04-26T02:26:31.792378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:36.126579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":184,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:27.918718+0000","last_change":"2024-04-26T02:25:37.894246+0000","last_active":"2024-04-26T02:26:27.918718+0000","last_peered":"2024-04-26T02:26:27.918718+0000","last_clean":"2024-04-26T02:26:27.918718+0000","last_became_active":"2024-04-26T02:25:36.003450+0000","last_became_peered":"2024-04-26T02:25:36.003450+0000","last_unstale":"2024-04-26T02:26:27.918718+0000","last_undegraded":"2024-04-26T02:26:27.918718+0000","last_fullsized":"2024-04-26T02:26:27.918718+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:25:37.894136+0000","last_clean_scrub_stamp":"2024-04-26T02:25:37.894136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:41.075750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:30.789292+0000","last_change":"2024-04-26T02:26:30.789311+0000","last_active":"2024-04-26T02:26:30.789292+0000","last_peered":"2024-04-26T02:26:30.789292+0000","last_clean":"2024-04-26T02:26:30.789292+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:26:30.789292+0000","last_undegraded":"2024-04-26T02:26:30.789292+0000","last_fullsized":"2024-04-26T02:26:30.789292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:30.789217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:30.789217+0000","last_clean_scrub_stamp":"2024-04-26T02:26:30.789217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:33.170469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":278,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:27.918192+0000","last_change":"2024-04-26T02:26:26.352091+0000","last_active":"2024-04-26T02:26:27.918192+0000","last_peered":"2024-04-26T02:26:27.918192+0000","last_clean":"2024-04-26T02:26:27.918192+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:26:27.918192+0000","last_undegraded":"2024-04-26T02:26:27.918192+0000","last_fullsized":"2024-04-26T02:26:27.918192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:26.351870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:26:26.351870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:31.811145+0000","last_change":"2024-04-26T02:26:31.811195+0000","last_active":"2024-04-26T02:26:31.811145+0000","last_peered":"2024-04-26T02:26:31.811145+0000","last_clean":"2024-04-26T02:26:31.811145+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:26:31.811145+0000","last_undegraded":"2024-04-26T02:26:31.811145+0000","last_fullsized":"2024-04-26T02:26:31.811145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:31.810978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:31.810978+0000","last_clean_scrub_stamp":"2024-04-26T02:26:31.810978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:54.226214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":276,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:31.300619+0000","last_change":"2024-04-26T02:26:31.300670+0000","last_active":"2024-04-26T02:26:31.300619+0000","last_peered":"2024-04-26T02:26:31.300619+0000","last_clean":"2024-04-26T02:26:31.300619+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:26:31.300619+0000","last_undegraded":"2024-04-26T02:26:31.300619+0000","last_fullsized":"2024-04-26T02:26:31.300619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:31.300456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:23:49.896447+0000","last_clean_scrub_stamp":"2024-04-26T02:26:31.300456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:28:00.931655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":278,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:29.764285+0000","last_change":"2024-04-26T02:26:29.764419+0000","last_active":"2024-04-26T02:26:29.764285+0000","last_peered":"2024-04-26T02:26:29.764285+0000","last_clean":"2024-04-26T02:26:29.764285+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:26:29.764285+0000","last_undegraded":"2024-04-26T02:26:29.764285+0000","last_fullsized":"2024-04-26T02:26:29.764285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:29.764043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:29.764043+0000","last_clean_scrub_stamp":"2024-04-26T02:26:29.764043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:35.796222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":118,"seq":506806140940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31244,"kb_used_data":2304,"kb_used_omap":5,"kb_used_meta":28922,"kb_avail":94340596,"statfs":{"total":96636764160,"available":96604770304,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5407,"internal_metadata":29616865},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215141,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51528,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320312,"statfs":{"total":96636764160,"available":96583999488,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320308,"statfs":{"total":96636764160,"available":96583995392,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313253,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280549,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320308,"statfs":{"total":96636764160,"available":96583995392,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[0,1,2,3,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280550,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29328,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342512,"statfs":{"total":96636764160,"available":96606732288,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":14,"up_from":115,"seq":493921239054,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":2304,"kb_used_omap":16,"kb_used_meta":29551,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17125,"internal_metadata":30260507},"hb_peers":[0,1,2,4,5,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280548,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280548,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34004,"kb_used_data":2824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337836,"statfs":{"total":96636764160,"available":96601944064,"internally_reserved":0,"allocated":2891776,"data_stored":1921312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280549,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34008,"kb_used_data":2824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337832,"statfs":{"total":96636764160,"available":96601939968,"internally_reserved":0,"allocated":2891776,"data_stored":1921312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280548,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280549,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280549,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51536,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320304,"statfs":{"total":96636764160,"available":96583991296,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215141,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51536,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320304,"statfs":{"total":96636764160,"available":96583991296,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:26:37.207 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T02:26:12.841309+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=26, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=26, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T02:26:37.207 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T02:25:38.921358+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=25, tm_sec=38, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=26, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T02:26:37.207 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T02:25:37.894136+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=25, tm_sec=37, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=26, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T02:26:37.207 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T02:26:26.351870+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=26, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=2, tm_min=26, tm_sec=26, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T02:26:37.207 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T02:26:57.209 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T02:26:57.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-26T02:26:57.515 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-26T02:26:57.531 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-04-26T02:26:56.762414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":11,"kb":1509949440,"kb_used":619004,"kb_used_data":37904,"kb_used_omap":43,"kb_used_meta":580884,"kb_avail":1509330436,"statfs":{"total":1546188226560,"available":1545554366464,"internally_reserved":0,"allocated":38813696,"data_stored":23336000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":44860,"internal_metadata":594825412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003752"},"pg_stats":[{"pgid":"1.0","version":"154'159","reported_seq":490,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:33.850505+0000","last_change":"2024-04-26T02:26:33.850576+0000","last_active":"2024-04-26T02:26:33.850505+0000","last_peered":"2024-04-26T02:26:33.850505+0000","last_clean":"2024-04-26T02:26:33.850505+0000","last_became_active":"2024-04-26T02:23:47.988374+0000","last_became_peered":"2024-04-26T02:23:47.988374+0000","last_unstale":"2024-04-26T02:26:33.850505+0000","last_undegraded":"2024-04-26T02:26:33.850505+0000","last_fullsized":"2024-04-26T02:26:33.850505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"154'159","last_scrub_stamp":"2024-04-26T02:26:33.850320+0000","last_deep_scrub":"154'159","last_deep_scrub_stamp":"2024-04-26T02:26:33.850320+0000","last_clean_scrub_stamp":"2024-04-26T02:26:33.850320+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:42.048147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:35.026748+0000","last_change":"2024-04-26T02:26:35.026850+0000","last_active":"2024-04-26T02:26:35.026748+0000","last_peered":"2024-04-26T02:26:35.026748+0000","last_clean":"2024-04-26T02:26:35.026748+0000","last_became_active":"2024-04-26T02:25:36.612717+0000","last_became_peered":"2024-04-26T02:25:36.612717+0000","last_unstale":"2024-04-26T02:26:35.026748+0000","last_undegraded":"2024-04-26T02:26:35.026748+0000","last_fullsized":"2024-04-26T02:26:35.026748+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:35.026544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:35.026544+0000","last_clean_scrub_stamp":"2024-04-26T02:26:35.026544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:40.609231+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,0],"acting":[14,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":286,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:31.792461+0000","last_change":"2024-04-26T02:26:31.792499+0000","last_active":"2024-04-26T02:26:31.792461+0000","last_peered":"2024-04-26T02:26:31.792461+0000","last_clean":"2024-04-26T02:26:31.792461+0000","last_became_active":"2024-04-26T02:23:51.065291+0000","last_became_peered":"2024-04-26T02:23:51.065291+0000","last_unstale":"2024-04-26T02:26:31.792461+0000","last_undegraded":"2024-04-26T02:26:31.792461+0000","last_fullsized":"2024-04-26T02:26:31.792461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:31.792378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:31.792378+0000","last_clean_scrub_stamp":"2024-04-26T02:26:31.792378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:36.126579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":193,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:34.069694+0000","last_change":"2024-04-26T02:26:34.069754+0000","last_active":"2024-04-26T02:26:34.069694+0000","last_peered":"2024-04-26T02:26:34.069694+0000","last_clean":"2024-04-26T02:26:34.069694+0000","last_became_active":"2024-04-26T02:25:36.003450+0000","last_became_peered":"2024-04-26T02:25:36.003450+0000","last_unstale":"2024-04-26T02:26:34.069694+0000","last_undegraded":"2024-04-26T02:26:34.069694+0000","last_fullsized":"2024-04-26T02:26:34.069694+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:34.069512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:34.069512+0000","last_clean_scrub_stamp":"2024-04-26T02:26:34.069512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:52.521190+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,15],"acting":[14,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:30.789292+0000","last_change":"2024-04-26T02:26:30.789311+0000","last_active":"2024-04-26T02:26:30.789292+0000","last_peered":"2024-04-26T02:26:30.789292+0000","last_clean":"2024-04-26T02:26:30.789292+0000","last_became_active":"2024-04-26T02:23:50.971877+0000","last_became_peered":"2024-04-26T02:23:50.971877+0000","last_unstale":"2024-04-26T02:26:30.789292+0000","last_undegraded":"2024-04-26T02:26:30.789292+0000","last_fullsized":"2024-04-26T02:26:30.789292+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:30.789217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:30.789217+0000","last_clean_scrub_stamp":"2024-04-26T02:26:30.789217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:33.170469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,7],"acting":[8,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":287,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:36.400694+0000","last_change":"2024-04-26T02:26:36.400800+0000","last_active":"2024-04-26T02:26:36.400694+0000","last_peered":"2024-04-26T02:26:36.400694+0000","last_clean":"2024-04-26T02:26:36.400694+0000","last_became_active":"2024-04-26T02:23:50.926830+0000","last_became_peered":"2024-04-26T02:23:50.926830+0000","last_unstale":"2024-04-26T02:26:36.400694+0000","last_undegraded":"2024-04-26T02:26:36.400694+0000","last_fullsized":"2024-04-26T02:26:36.400694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:36.400492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:36.400492+0000","last_clean_scrub_stamp":"2024-04-26T02:26:36.400492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:45.258700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,15],"acting":[11,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:31.811145+0000","last_change":"2024-04-26T02:26:31.811195+0000","last_active":"2024-04-26T02:26:31.811145+0000","last_peered":"2024-04-26T02:26:31.811145+0000","last_clean":"2024-04-26T02:26:31.811145+0000","last_became_active":"2024-04-26T02:23:50.970607+0000","last_became_peered":"2024-04-26T02:23:50.970607+0000","last_unstale":"2024-04-26T02:26:31.811145+0000","last_undegraded":"2024-04-26T02:26:31.811145+0000","last_fullsized":"2024-04-26T02:26:31.811145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:31.810978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:31.810978+0000","last_clean_scrub_stamp":"2024-04-26T02:26:31.810978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:54.226214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":285,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:37.193011+0000","last_change":"2024-04-26T02:26:37.193070+0000","last_active":"2024-04-26T02:26:37.193011+0000","last_peered":"2024-04-26T02:26:37.193011+0000","last_clean":"2024-04-26T02:26:37.193011+0000","last_became_active":"2024-04-26T02:23:50.924917+0000","last_became_peered":"2024-04-26T02:23:50.924917+0000","last_unstale":"2024-04-26T02:26:37.193011+0000","last_undegraded":"2024-04-26T02:26:37.193011+0000","last_fullsized":"2024-04-26T02:26:37.193011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:37.192840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:37.192840+0000","last_clean_scrub_stamp":"2024-04-26T02:26:37.192840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:40.737236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,13],"acting":[15,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":278,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-04-26T02:26:29.764285+0000","last_change":"2024-04-26T02:26:29.764419+0000","last_active":"2024-04-26T02:26:29.764285+0000","last_peered":"2024-04-26T02:26:29.764285+0000","last_clean":"2024-04-26T02:26:29.764285+0000","last_became_active":"2024-04-26T02:23:50.924519+0000","last_became_peered":"2024-04-26T02:23:50.924519+0000","last_unstale":"2024-04-26T02:26:29.764285+0000","last_undegraded":"2024-04-26T02:26:29.764285+0000","last_fullsized":"2024-04-26T02:26:29.764285+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T02:26:29.764043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T02:26:29.764043+0000","last_clean_scrub_stamp":"2024-04-26T02:26:29.764043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:27:35.796222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10],"acting":[8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":12,"up_from":118,"seq":506806140944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31244,"kb_used_data":2304,"kb_used_omap":5,"kb_used_meta":28922,"kb_avail":94340596,"statfs":{"total":96636764160,"available":96604770304,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5407,"internal_metadata":29616865},"hb_peers":[0,1,2,3,4,9,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":24,"seq":103079215145,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51528,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320312,"statfs":{"total":96636764160,"available":96583999488,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[2,3,5,6,7,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":24,"seq":103079215146,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320308,"statfs":{"total":96636764160,"available":96583995392,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,5,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,7,8,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":22,"seq":94489280553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51532,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320308,"statfs":{"total":96636764160,"available":96583995392,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":50395584},"hb_peers":[0,1,2,3,7,8,9,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":22,"seq":94489280554,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29320,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342520,"statfs":{"total":96636764160,"available":96606740480,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,6,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,6,7,8,9,10,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":115,"seq":493921239058,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31880,"kb_used_data":2304,"kb_used_omap":16,"kb_used_meta":29551,"kb_avail":94339960,"statfs":{"total":96636764160,"available":96604119040,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17125,"internal_metadata":30260507},"hb_peers":[0,1,2,4,5,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":22,"seq":94489280554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33488,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,3,4,6,7,8,9,10,11,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280552,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33480,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338360,"statfs":{"total":96636764160,"available":96602480640,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,6,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":22,"seq":94489280552,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34000,"kb_used_data":2824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337840,"statfs":{"total":96636764160,"available":96601948160,"internally_reserved":0,"allocated":2891776,"data_stored":1921312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,4,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":22,"seq":94489280553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34000,"kb_used_data":2824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337840,"statfs":{"total":96636764160,"available":96601948160,"internally_reserved":0,"allocated":2891776,"data_stored":1921312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,5,7,8,9,10,11,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280552,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33480,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338360,"statfs":{"total":96636764160,"available":96602480640,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[4,5,6,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":22,"seq":94489280553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33480,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338360,"statfs":{"total":96636764160,"available":96602480640,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,2,5,6,7,8,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":22,"seq":94489280553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51528,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320312,"statfs":{"total":96636764160,"available":96583999488,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[4,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":24,"seq":103079215145,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51536,"kb_used_data":2304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320304,"statfs":{"total":96636764160,"available":96583991296,"internally_reserved":0,"allocated":2359296,"data_stored":1392384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7,9,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T02:26:57.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T02:26:57.863 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T02:26:57.863 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T02:26:57.864 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T02:26:57.864 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:26:57.947 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T02:26:57.947 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T02:26:57.948 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:26:58.019 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T02:26:58.019 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-04-26T02:26:58.020 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:26:58.118 INFO:tasks.ceph.osd.8:Stopped 2024-04-26T02:26:58.119 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2024-04-26T02:26:58.119 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:26:58.194 INFO:tasks.ceph.osd.12:Stopped 2024-04-26T02:26:58.194 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T02:26:58.194 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:26:58.283 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T02:26:58.283 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T02:26:58.283 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:04.386 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T02:27:04.386 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-04-26T02:27:04.386 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:04.452 INFO:tasks.ceph.osd.9:Stopped 2024-04-26T02:27:04.452 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2024-04-26T02:27:04.452 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:04.550 INFO:tasks.ceph.osd.13:Stopped 2024-04-26T02:27:04.550 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T02:27:04.550 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:04.640 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T02:27:04.640 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T02:27:04.640 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:04.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-26T02:27:10.742 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T02:27:10.742 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-04-26T02:27:10.743 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:10.806 INFO:tasks.ceph.osd.10:Stopped 2024-04-26T02:27:10.806 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2024-04-26T02:27:10.806 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:10.890 INFO:tasks.ceph.osd.14:Stopped 2024-04-26T02:27:10.890 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T02:27:10.890 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:10.991 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T02:27:10.992 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T02:27:10.992 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-26T02:27:11.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-26T02:27:11.093 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T02:27:11.094 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-04-26T02:27:11.094 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.181 INFO:tasks.ceph.osd.11:Stopped 2024-04-26T02:27:11.181 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2024-04-26T02:27:11.181 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.277 INFO:tasks.ceph.osd.15:Stopped 2024-04-26T02:27:11.277 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T02:27:11.277 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T02:27:11.277 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.307 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T02:27:11.307 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T02:27:11.308 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.339 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T02:27:11.339 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T02:27:11.339 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T02:27:11.340 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.366 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T02:27:11.367 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T02:27:11.367 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.391 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T02:27:11.392 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T02:27:11.392 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T02:27:11.413 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T02:27:11.414 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T02:27:11.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'slow request' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-26T02:27:11.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:27:11.431 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T02:27:11.757 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:27:11.758 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T02:27:11.983 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:27:11.984 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-04-26T02:27:12.281 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:27:12.281 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2024-04-26T02:27:12.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:27:12.431 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T02:27:12.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:27:12.728 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T02:27:12.943 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:27:12.943 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-04-26T02:27:13.140 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:27:13.140 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2024-04-26T02:27:13.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:27:13.365 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T02:27:13.809 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:27:13.809 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T02:27:13.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:27:13.984 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-04-26T02:27:14.177 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:27:14.177 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2024-04-26T02:27:14.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:27:14.343 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T02:27:14.600 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:27:14.601 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T02:27:14.753 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:27:14.753 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-04-26T02:27:14.893 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:27:14.894 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2024-04-26T02:27:15.028 INFO:tasks.ceph:Archiving mon data... 2024-04-26T02:27:15.029 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/data/mon.a.tgz 2024-04-26T02:27:15.029 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-04-26T02:27:15.035 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.SRNPb3f8EP 2024-04-26T02:27:15.035 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SRNPb3f8EP 2024-04-26T02:27:15.189 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.SRNPb3f8EP 2024-04-26T02:27:15.248 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.SRNPb3f8EP is 457KB 2024-04-26T02:27:15.315 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.SRNPb3f8EP 2024-04-26T02:27:15.319 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/data/mon.b.tgz 2024-04-26T02:27:15.320 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-04-26T02:27:15.326 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.ydQgel11RQ 2024-04-26T02:27:15.326 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ydQgel11RQ 2024-04-26T02:27:15.519 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.ydQgel11RQ 2024-04-26T02:27:15.586 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.ydQgel11RQ is 632KB 2024-04-26T02:27:15.649 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.ydQgel11RQ 2024-04-26T02:27:15.654 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/data/mon.c.tgz 2024-04-26T02:27:15.655 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-26T02:27:15.661 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.yDEmZpPIaP 2024-04-26T02:27:15.661 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.yDEmZpPIaP 2024-04-26T02:27:15.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.yDEmZpPIaP 2024-04-26T02:27:15.919 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.yDEmZpPIaP is 632KB 2024-04-26T02:27:15.981 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.yDEmZpPIaP 2024-04-26T02:27:15.986 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T02:27:15.986 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T02:27:15.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T02:27:15.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T02:27:16.032 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T02:27:16.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-26T02:27:16.051 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T02:27:16.057 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T02:27:16.091 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T02:27:16.097 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T02:27:16.097 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T02:27:16.098 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi059/crash 2024-04-26T02:27:16.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T02:27:16.113 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi136/crash 2024-04-26T02:27:16.114 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T02:27:16.128 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi142/crash 2024-04-26T02:27:16.129 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T02:27:16.147 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi175/crash 2024-04-26T02:27:16.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T02:27:16.162 INFO:tasks.ceph:Compressing logs... 2024-04-26T02:27:16.163 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T02:27:16.165 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T02:27:16.176 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T02:27:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31614.log 2024-04-26T02:27:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33304.log 2024-04-26T02:27:16.186 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31614.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.31614.log.gz /var/log/ceph/ceph-client.admin.30620.log 2024-04-26T02:27:16.186 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:16.187 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31200.log 2024-04-26T02:27:16.187 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33304.log.gz 2024-04-26T02:27:16.187 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40103.log 2024-04-26T02:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30620.log.gz 2024-04-26T02:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38725.log 2024-04-26T02:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31200.log.gz 2024-04-26T02:27:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40103.log.gz 2024-04-26T02:27:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2024-04-26T02:27:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38725.log: gzip -5 28.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38725.log.gz 2024-04-26T02:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr: /var/log/ceph/ceph-client.admin.39460.log 2024-04-26T02:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35432.log 2024-04-26T02:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2024-04-26T02:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39460.log.gz 2024-04-26T02:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40675.log 2024-04-26T02:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35432.log.gz 2024-04-26T02:27:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30763.log 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34942.log 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40675.log.gz 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30763.log.gz 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30678.log 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34942.log: 24.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.34942.log.gz 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39459.log 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40831.log 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30678.log.gz 2024-04-26T02:27:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39459.log.gz 2024-04-26T02:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T02:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40831.log.gz 2024-04-26T02:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31150.log 2024-04-26T02:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5/var/log/ceph/ceph-mgr.y.log: --verbose -- /var/log/ceph/ceph-client.admin.39526.log 2024-04-26T02:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31150.log.gz 2024-04-26T02:27:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31973.log 2024-04-26T02:27:16.195 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T02:27:16.203 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T02:27:16.203 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T02:27:16.203 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T02:27:16.203 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T02:27:16.203 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-04-26T02:27:16.203 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2024-04-26T02:27:16.203 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T02:27:16.204 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.13.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T02:27:16.204 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.b.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T02:27:16.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35992.log 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39526.log.gz 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31973.log.gz 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39120.log 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31692.log 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35992.log.gz 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39120.log.gz 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35026.log 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5/var/log/ceph/ceph-client.admin.31692.log: --verbose -- /var/log/ceph/ceph-client.admin.35208.log 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31692.log.gz 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40753.log 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35026.log.gz 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35208.log.gz 2024-04-26T02:27:16.210 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38751.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.40753.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33174.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40753.log.gz 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33569.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38751.log.gz 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33174.log.gz 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39895.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33569.log.gz 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25092.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39895.log.gz 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38439.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.25092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32243.log 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25092.log.gz 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38439.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38439.log.gz -5 2024-04-26T02:27:16.211 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33895.log 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40233.log/var/log/ceph/ceph-client.admin.32243.log: 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32243.log.gz 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33895.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33895.log.gz 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32130.log 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33204.log 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40233.log.gz 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32130.log.gz 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39103.log 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34516.log 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33204.log.gz 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39103.log.gz 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39524.log 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39102.log 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.34516.log.gz 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39524.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39524.log.gz -5 2024-04-26T02:27:16.212 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39116.log 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39102.log.gz 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.36390.log 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38621.log 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39116.log.gz 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/objectstore_tool.36390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38699.log 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38621.log.gz 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31903.log 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38699.log.gz 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30787.log 2024-04-26T02:27:16.213 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31903.log.gz 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40935.log 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30787.log.gz 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33200.log 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40935.log.gz 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5/var/log/ceph/ceph-client.admin.38803.log: --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39520.log 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33200.log.gz 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38881.log 2024-04-26T02:27:16.214 INFO:teuthology.orchestra.run.smithi059.stderr: 27.1% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-04-26T02:27:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38907.log 2024-04-26T02:27:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39520.log.gz 2024-04-26T02:27:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35458.log 2024-04-26T02:27:16.215 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38881.log.gz 2024-04-26T02:27:16.215 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33653.log 2024-04-26T02:27:16.215 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38907.log.gz 2024-04-26T02:27:16.219 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.33097.log 2024-04-26T02:27:16.219 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.31541.log 2024-04-26T02:27:16.219 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/objectstore_tool.33097.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T02:27:16.220 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/objectstore_tool.31541.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T02:27:16.220 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.34595.log 2024-04-26T02:27:16.220 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2024-04-26T02:27:16.220 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/objectstore_tool.34595.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.33844.log 2024-04-26T02:27:16.238 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T02:27:16.238 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/objectstore_tool.33844.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T02:27:16.238 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T02:27:16.238 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.32304.log 2024-04-26T02:27:16.258 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T02:27:16.258 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/objectstore_tool.32304.log: 93.9% -- replaced with /var/log/ceph/objectstore_tool.31541.log.gz 2024-04-26T02:27:16.259 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.30024.log 2024-04-26T02:27:16.259 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T02:27:16.259 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9%gzip -5 --verbose -- /var/log/ceph/objectstore_tool.30774.log 2024-04-26T02:27:16.259 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/objectstore_tool.33097.log.gz 2024-04-26T02:27:16.259 INFO:teuthology.orchestra.run.smithi142.stderr: 93.7% -- replaced with /var/log/ceph/objectstore_tool.33844.log.gz 2024-04-26T02:27:16.259 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/objectstore_tool.30024.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-04-26T02:27:16.259 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/objectstore_tool.30774.log: 93.8% -- replaced with /var/log/ceph/objectstore_tool.34595.log.gz 2024-04-26T02:27:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24977.log 2024-04-26T02:27:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29564.log 2024-04-26T02:27:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.24977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25248.log 2024-04-26T02:27:16.263 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24977.log.gz 2024-04-26T02:27:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.29564.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T02:27:16.263 INFO:teuthology.orchestra.run.smithi175.stderr: 73.8% -- replaced with /var/log/ceph/ceph-client.0.29564.log.gz 2024-04-26T02:27:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25248.log.gz 2024-04-26T02:27:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25097.log 2024-04-26T02:27:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25049.log 2024-04-26T02:27:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.25097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25073.log 2024-04-26T02:27:16.264 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25097.log.gz 2024-04-26T02:27:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25049.log.gz 2024-04-26T02:27:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24953.log 2024-04-26T02:27:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25121.log 2024-04-26T02:27:16.265 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25073.log: /var/log/ceph/ceph-client.admin.24953.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T02:27:16.265 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24953.log.gz 2024-04-26T02:27:16.265 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25073.log.gz 2024-04-26T02:27:16.265 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25121.log.gz 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24929.log 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25297.log 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.24929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.24929.log.gz 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25224.log 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25297.log: /var/log/ceph/ceph-client.admin.25224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25297.log.gz 2024-04-26T02:27:16.266 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25224.log.gz 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25272.log 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.15.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25152.log 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25272.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25272.log.gz 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.25001.log 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25025.log 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25152.log.gz 2024-04-26T02:27:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25200.log 2024-04-26T02:27:16.268 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25001.log.gz 2024-04-26T02:27:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25176.log 2024-04-26T02:27:16.268 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25025.log.gz 2024-04-26T02:27:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25200.log.gz 2024-04-26T02:27:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.25176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25176.log.gz 2024-04-26T02:27:16.268 INFO:teuthology.orchestra.run.smithi175.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T02:27:16.271 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.10.log: 93.6% -- replaced with /var/log/ceph/objectstore_tool.32304.log.gz 2024-04-26T02:27:16.271 INFO:teuthology.orchestra.run.smithi142.stderr: 94.1% -- replaced with /var/log/ceph/objectstore_tool.30774.log.gz 2024-04-26T02:27:16.302 INFO:teuthology.orchestra.run.smithi136.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T02:27:16.313 INFO:teuthology.orchestra.run.smithi142.stderr: 94.7% -- replaced with /var/log/ceph/objectstore_tool.30024.log.gz 2024-04-26T02:27:16.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32993.log 2024-04-26T02:27:16.330 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35458.log.gz 2024-04-26T02:27:16.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33043.log 2024-04-26T02:27:16.330 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33653.log.gz 2024-04-26T02:27:16.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32993.log.gz 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33043.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33043.log.gz 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30704.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30772.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30704.log.gz 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39479.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30772.log.gz 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39899.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38335.log 2024-04-26T02:27:16.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39479.log.gz 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39899.log.gz 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39519.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38335.log.gz 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.35612.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32642.log: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34143.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39519.log.gz 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/objectstore_tool.35612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35183.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34143.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.34143.log.gz -- 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr: /var/log/ceph/ceph-client.admin.39529.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40779.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35183.log.gz/var/log/ceph/ceph-client.admin.39529.log: 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38179.log 2024-04-26T02:27:16.332 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39529.log.gz 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40779.log.gz 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33627.log 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38179.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.38179.log.gz --verbose 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph-mon.a.log 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40337.log 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33627.log.gz/var/log/ceph/ceph-mon.a.log: 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39502.log 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40337.log.gz 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32925.log 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41013.log 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39502.log.gz 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31139.log 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32925.log.gz 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41013.log.gz 2024-04-26T02:27:16.333 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34001.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30779.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31139.log.gz 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34001.log: gzip -5 --verbose -- /var/log/ceph/bluestore_tool.37146.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.34001.log.gz 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30779.log.gz 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33814.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31965.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/bluestore_tool.37146.log: 45.6% -- replaced with /var/log/ceph/bluestore_tool.37146.log.gz 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40649.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33814.log.gz 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31965.log.gz 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40571.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40129.log 2024-04-26T02:27:16.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40649.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40571.log: gzip -5 --verbose -- /var/log/ceph/bluestore_tool.37150.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40571.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40129.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35529.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40259.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/bluestore_tool.37150.log: /var/log/ceph/ceph-client.admin.35529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35529.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr: 93.9% -- replaced with /var/log/ceph/objectstore_tool.36390.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39903.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40259.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33657.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39903.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34813.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31194.log 2024-04-26T02:27:16.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33657.log: 0.0%/var/log/ceph/ceph-client.admin.34813.log: -- replaced with /var/log/ceph/ceph-client.admin.33657.log.gz 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.34813.log.gz 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35294.log 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32075.log 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31194.log.gz 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35294.log.gz 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40363.log 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32075.log: gzip 93.7% -- replaced with /var/log/ceph/bluestore_tool.37150.log.gz -5 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38933.log 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.32075.log.gz 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34728.log 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40363.log.gz 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32721.log 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38933.log.gz 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34728.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39081.log 2024-04-26T02:27:16.336 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34728.log.gz 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38959.log 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.32721.log.gz 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31172.log 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39081.log: /var/log/ceph/ceph-client.admin.38959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35264.log 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39081.log.gz 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38959.log.gz 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31172.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39098.log 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34253.log 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35264.log.gz 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39098.log.gz 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39973.log 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39093.log 2024-04-26T02:27:16.337 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34253.log.gz 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39973.log: gzip -5 --verbose -- /var/log/ceph/bluestore_tool.37522.log 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39973.log.gz 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35000.log 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39093.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31132.log 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/bluestore_tool.37522.log: /var/log/ceph/ceph-client.admin.35000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35000.log.gz 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38257.log 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39037.log 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31132.log.gz 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38257.log.gz 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38465.log 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40909.log 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39037.log: /var/log/ceph/ceph-client.admin.38465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39037.log.gz 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38465.log.gz 2024-04-26T02:27:16.338 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/bluestore_tool.37894.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40467.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40909.log: /var/log/ceph/bluestore_tool.37894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40909.log.gz 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35058.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40467.log.gz 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40389.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35058.log.gz 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40389.log.gz 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31588.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr: 93.8% -- replaced with /var/log/ceph/bluestore_tool.37522.log.gz 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32778.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- 92.3% /var/log/ceph/ceph-client.admin.35308.log 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/bluestore_tool.37894.log.gz 2024-04-26T02:27:16.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31588.log: /var/log/ceph/ceph-client.admin.32778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31588.log.gz 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32778.log.gz 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39525.log 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30773.log 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35308.log: /var/log/ceph/ceph-client.admin.39525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39580.log 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39525.log.gz/var/log/ceph/ceph-client.admin.30773.log: 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30773.log.gz 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25318.log 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33864.log 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39580.log: /var/log/ceph/ceph-client.admin.25318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39999.log 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25318.log.gz 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39580.log.gz 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33864.log.gz 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40181.log 2024-04-26T02:27:16.340 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38205.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39999.log: /var/log/ceph/ceph-client.admin.40181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35107.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39999.log.gz 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40181.log.gz 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38205.log.gz 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30778.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33788.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35107.log: /var/log/ceph/ceph-client.admin.30778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31792.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35107.log.gz 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30778.log.gz 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33788.log.gz 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30789.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40597.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31792.log: /var/log/ceph/ceph-client.admin.30789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31748.log 2024-04-26T02:27:16.341 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31792.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30789.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40597.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38413.log 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31193.log 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31748.log: /var/log/ceph/ceph-client.admin.38413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30771.log 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31748.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38413.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31193.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30767.log 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33484.log 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30771.log: /var/log/ceph/ceph-client.admin.30767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32372.log 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30771.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30767.log.gz 2024-04-26T02:27:16.342 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33484.log.gz 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40311.log 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31181.log 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32372.log: /var/log/ceph/ceph-client.admin.40311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34381.log 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32372.log.gz 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40311.log.gz 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31181.log.gz 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40961.log 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31666.log 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34381.log: /var/log/ceph/ceph-client.admin.40961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38387.log 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34381.log.gz 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40961.log.gz 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31666.log.gz 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40545.log 2024-04-26T02:27:16.343 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40025.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38387.log: /var/log/ceph/ceph-client.admin.40545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39088.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38387.log.gz 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40545.log.gz 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40025.log.gz 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38309.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39088.log: /var/log/ceph/ceph-client.admin.38855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35590.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39088.log.gz 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38309.log.gz 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34407.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31147.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35590.log: /var/log/ceph/ceph-client.admin.34407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31228.log 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35590.log.gz 2024-04-26T02:27:16.344 INFO:teuthology.orchestra.run.smithi059.stderr: 24.1%/var/log/ceph/ceph-client.admin.31147.log: -- replaced with /var/log/ceph/ceph-client.admin.34407.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31147.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30790.log 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38231.log 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31228.log: /var/log/ceph/ceph-client.admin.30790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40441.log 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30790.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31228.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38231.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33544.log 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20156.log 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40441.log: /var/log/ceph/ceph-client.admin.33544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30548.log 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33544.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0%/var/log/ceph/ceph.tmp-client.admin.20156.log: -- replaced with /var/log/ceph/ceph-client.admin.40441.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20156.log.gz 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T02:27:16.345 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34732.log 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30548.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31167.log 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30548.log.gz 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34732.log: 24.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39011.log 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34732.log.gz 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31167.log.gz 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32639.log 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33283.log 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39011.log.gz 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32639.log.gz 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39123.log 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32162.log 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34189.log/var/log/ceph/ceph-client.admin.39123.log: 2024-04-26T02:27:16.346 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39123.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33283.log.gz 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32162.log.gz 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39115.log 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33126.log 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34189.log: /var/log/ceph/ceph-client.admin.39115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38517.log 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34189.log.gz 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39115.log.gz/var/log/ceph/ceph-client.admin.33126.log: 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33126.log.gz 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40077.log 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39101.log 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38517.log: /var/log/ceph/ceph-client.admin.40077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32398.log 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38517.log.gz 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40077.log.gz 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39101.log.gz 2024-04-26T02:27:16.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24973.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33122.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32398.log: /var/log/ceph/ceph-client.admin.24973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31192.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr: 25.6% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32398.log.gz 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.24973.log.gz 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33122.log.gz 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34704.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33364.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31192.log: /var/log/ceph/ceph-client.admin.34704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33479.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31192.log.gz 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34704.log.gz 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33364.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33364.log.gz 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34638.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32921.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33479.log: /var/log/ceph/ceph-client.admin.34638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31640.log 2024-04-26T02:27:16.348 INFO:teuthology.orchestra.run.smithi059.stderr: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.34638.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0%/var/log/ceph/ceph-client.admin.32921.log: -- replaced with /var/log/ceph/ceph-client.admin.33479.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32921.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30576.log 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39433.log 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31640.log: /var/log/ceph/ceph-client.admin.30576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33335.log 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30576.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31640.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39433.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34464.log 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30770.log 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33335.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34464.log.gz 2024-04-26T02:27:16.349 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33335.log.gz 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30770.log.gz 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32529.log 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34106.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gz -5 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39113.log 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39096.log 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32529.log.gz 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40415.log 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39113.log.gz 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39096.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39096.log.gz 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31562.log 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40415.log.gz 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40285.log 2024-04-26T02:27:16.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40883.log 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31562.log.gz 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38829.log 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40285.log.gz 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40493.log 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38283.log 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38829.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40883.log.gz 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38829.log.gz 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40493.log.gz 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35289.log 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32572.log 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38283.log: /var/log/ceph/ceph-client.admin.35289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31174.log 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35289.log.gz 2024-04-26T02:27:16.351 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38283.log.gz 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38543.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32572.log.gz 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31174.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31174.log.gz 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38647.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38543.log: /var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40519.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38543.log.gz 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34605.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38647.log.gz 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40857.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40519.log.gz 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38777.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34605.log: /var/log/ceph/ceph-client.admin.40857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41037.log 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34605.log.gz 2024-04-26T02:27:16.352 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40857.log.gz 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32455.log 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38777.log.gz 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39476.log 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41037.log: /var/log/ceph/ceph-client.admin.32455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38148.log 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32455.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41037.log.gz 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39476.log.gz 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39514.log 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38122.log 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38148.log: /var/log/ceph/ceph-client.admin.39514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33400.log 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38148.log.gz 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39514.log.gz 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38122.log.gz 2024-04-26T02:27:16.353 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33709.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38361.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33400.log: /var/log/ceph/ceph-client.admin.33709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31718.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33400.log.gz 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33709.log.gz 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38361.log.gz 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38491.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31718.log.gz 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32289.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30781.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38491.log: /var/log/ceph/ceph-client.admin.32289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33705.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38491.log.gz 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr: 21.4% -- replaced with /var/log/ceph/ceph-client.admin.32289.log.gz/var/log/ceph/ceph-client.admin.30781.log: 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30781.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34324.log 2024-04-26T02:27:16.354 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40805.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33705.log: /var/log/ceph/ceph-client.admin.34324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30769.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr: 25.2% 24.8% -- replaced with /var/log/ceph/ceph-client.admin.33705.log.gz 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34324.log.gz 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40805.log.gz 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38673.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40051.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30769.log: /var/log/ceph/ceph-client.admin.38673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39121.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30769.log.gz 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38673.log.gz 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40051.log.gz 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34080.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39121.log: /var/log/ceph/ceph-client.admin.34080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32804.log 2024-04-26T02:27:16.355 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34080.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39121.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31974.log 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33997.log 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32804.log: /var/log/ceph/ceph-client.admin.31974.log: 24.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32804.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31974.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32480.log 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32834.log 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33997.log: /var/log/ceph/ceph-client.admin.32480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33997.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.32480.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40207.log 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34838.log 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32834.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40207.log.gz 2024-04-26T02:27:16.356 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31787.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34838.log.gz 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40155.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31787.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.31787.log.gz 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33840.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40155.log.gz 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39119.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38569.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33840.log.gz 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39119.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30751.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38569.log.gz 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40623.log 2024-04-26T02:27:16.357 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31227.log 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30751.log: /var/log/ceph/ceph-client.admin.40623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30751.log.gz 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40623.log.gz 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32829.log 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38595.log 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31227.log: /var/log/ceph/ceph-client.admin.32829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31227.log.gz 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.32829.log.gz 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35528.log 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr: 94.8% -- replaced with /var/log/ceph/objectstore_tool.35612.log.gz 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30788.log 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38595.log.gz 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35528.log.gz 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31158.log 2024-04-26T02:27:16.358 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30788.log: /var/log/ceph/ceph-client.admin.39555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31196.log 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30788.log.gz 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31158.log.gz 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40701.log 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31791.log 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31196.log.gz 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30756.log 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40701.log.gz 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.31791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33042.log 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31791.log.gz 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.30756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30756.log.gz 2024-04-26T02:27:16.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33042.log.gz 2024-04-26T02:27:16.360 INFO:teuthology.orchestra.run.smithi142.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T02:27:16.554 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-04-26T02:27:16.608 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T02:27:16.638 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T02:27:16.662 INFO:teuthology.orchestra.run.smithi136.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-04-26T02:27:16.668 INFO:teuthology.orchestra.run.smithi136.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2024-04-26T02:27:16.672 INFO:teuthology.orchestra.run.smithi136.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T02:27:16.708 INFO:teuthology.orchestra.run.smithi142.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T02:27:16.743 INFO:teuthology.orchestra.run.smithi175.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T02:27:16.807 INFO:teuthology.orchestra.run.smithi175.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2024-04-26T02:27:16.997 INFO:teuthology.orchestra.run.smithi136.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T02:27:16.998 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-04-26T02:27:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m0.820s 2024-04-26T02:27:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m2.257s 2024-04-26T02:27:16.998 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m0.090s 2024-04-26T02:27:17.055 INFO:teuthology.orchestra.run.smithi142.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2024-04-26T02:27:17.076 INFO:teuthology.orchestra.run.smithi059.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-04-26T02:27:17.080 INFO:teuthology.orchestra.run.smithi142.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-04-26T02:27:17.081 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-04-26T02:27:17.082 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m0.888s 2024-04-26T02:27:17.082 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m2.816s 2024-04-26T02:27:17.082 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.141s 2024-04-26T02:27:17.087 INFO:teuthology.orchestra.run.smithi175.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T02:27:17.089 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-26T02:27:17.089 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m0.880s 2024-04-26T02:27:17.089 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m2.201s 2024-04-26T02:27:17.089 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.109s 2024-04-26T02:27:17.165 INFO:teuthology.orchestra.run.smithi059.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T02:27:17.329 INFO:teuthology.orchestra.run.smithi059.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2024-04-26T02:27:17.365 INFO:teuthology.orchestra.run.smithi059.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T02:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-26T02:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m1.200s 2024-04-26T02:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m4.658s 2024-04-26T02:27:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.221s 2024-04-26T02:27:17.368 INFO:tasks.ceph:Archiving logs... 2024-04-26T02:27:17.368 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi059/log 2024-04-26T02:27:17.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T02:27:18.174 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi136/log 2024-04-26T02:27:18.175 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T02:27:18.519 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi142/log 2024-04-26T02:27:18.520 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T02:27:18.945 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi175/log 2024-04-26T02:27:18.946 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T02:27:19.270 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T02:27:19.278 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T02:27:19.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T02:27:19.281 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T02:27:19.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T02:27:19.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T02:27:19.401 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T02:27:19.410 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T02:27:19.411 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:27:19.413 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:27:19.416 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:27:19.419 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T02:27:19.424 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:27:19.424 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-04-26T02:27:19.424 INFO:teuthology.orchestra.run.smithi059.stdout:+hv01.front.sepi 67.205.162.81 3 u 38 64 177 0.101 -1.669 2.115 2024-04-26T02:27:19.425 INFO:teuthology.orchestra.run.smithi059.stdout:+hv02.front.sepi 63.231.80.2 3 u 36 64 177 0.079 +1.923 1.945 2024-04-26T02:27:19.425 INFO:teuthology.orchestra.run.smithi059.stdout:*hv03.front.sepi 74.6.168.72 3 u 36 64 177 0.084 -0.719 1.371 2024-04-26T02:27:19.425 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:27:19.427 INFO:teuthology.orchestra.run.smithi136.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:27:19.427 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================== 2024-04-26T02:27:19.427 INFO:teuthology.orchestra.run.smithi136.stdout:+hv01.front.sepi 67.205.162.81 3 u 35 64 177 0.102 -2.826 0.932 2024-04-26T02:27:19.427 INFO:teuthology.orchestra.run.smithi136.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 177 0.106 +0.992 1.012 2024-04-26T02:27:19.427 INFO:teuthology.orchestra.run.smithi136.stdout:*hv03.front.sepi 74.6.168.72 3 u 31 64 177 0.133 -0.772 1.096 2024-04-26T02:27:19.427 INFO:teuthology.orchestra.run.smithi136.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:27:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:27:19.430 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================== 2024-04-26T02:27:19.430 INFO:teuthology.orchestra.run.smithi142.stdout:+hv01.front.sepi 67.205.162.81 3 u 34 64 177 0.106 -2.515 0.762 2024-04-26T02:27:19.430 INFO:teuthology.orchestra.run.smithi142.stdout:+hv02.front.sepi 63.231.80.2 3 u 29 64 177 0.164 +1.333 0.736 2024-04-26T02:27:19.430 INFO:teuthology.orchestra.run.smithi142.stdout:*hv03.front.sepi 74.6.168.72 3 u 29 64 177 0.148 -0.426 0.673 2024-04-26T02:27:19.430 INFO:teuthology.orchestra.run.smithi142.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:27:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T02:27:19.432 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-26T02:27:19.432 INFO:teuthology.orchestra.run.smithi175.stdout:+hv01.front.sepi 67.205.162.81 3 u 33 64 177 0.053 -3.793 1.297 2024-04-26T02:27:19.432 INFO:teuthology.orchestra.run.smithi175.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 177 0.067 +0.294 1.282 2024-04-26T02:27:19.432 INFO:teuthology.orchestra.run.smithi175.stdout:*hv03.front.sepi 74.6.168.72 3 u 29 64 177 0.088 -2.579 1.734 2024-04-26T02:27:19.432 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-26T02:27:19.432 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T02:27:19.443 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T02:27:19.443 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T02:27:19.453 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T02:27:19.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T02:27:19.471 INFO:teuthology.task.internal:Duration was 870.971565 seconds 2024-04-26T02:27:19.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T02:27:19.482 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T02:27:19.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T02:27:19.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T02:27:19.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T02:27:19.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T02:27:19.526 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T02:27:19.526 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-04-26T02:27:19.527 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T02:27:19.578 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-04-26T02:27:19.579 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T02:27:19.589 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-04-26T02:27:19.589 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T02:27:19.599 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-26T02:27:19.599 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T02:27:19.609 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T02:27:19.610 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T02:27:19.622 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T02:27:19.632 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T02:27:19.648 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T02:27:19.679 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T02:27:19.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T02:27:19.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T02:27:19.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T02:27:19.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T02:27:19.778 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T02:27:19.790 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T02:27:19.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T02:27:19.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T02:27:19.817 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T02:27:19.830 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T02:27:19.841 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T02:27:19.852 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.855 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.860 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.864 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-04-26T02:27:19.869 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-04-26T02:27:19.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.885 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-04-26T02:27:19.894 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-26T02:27:19.923 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.948 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:27:19.948 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:27:19.953 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.958 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:27:19.959 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T02:27:19.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T02:27:19.969 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T02:27:19.979 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T02:27:19.980 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi059 2024-04-26T02:27:19.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T02:27:20.013 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi136 2024-04-26T02:27:20.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T02:27:20.035 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi142 2024-04-26T02:27:20.036 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T02:27:20.059 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-04-26_01:23:56-rados-wip-yuri2-testing-2024-04-24-0914-squid-distro-default-smithi/7674287/remote/smithi175 2024-04-26T02:27:20.059 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T02:27:20.080 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T02:27:20.080 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T02:27:20.087 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T02:27:20.089 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T02:27:20.100 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T02:27:20.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T02:27:20.135 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T02:27:20.135 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T02:27:20.145 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T02:27:20.146 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T02:27:20.148 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T02:27:20.151 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T02:27:20.152 INFO:teuthology.orchestra.run.smithi059.stdout: 658464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 02:27 /home/ubuntu/cephtest 2024-04-26T02:27:20.153 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T02:27:20.155 INFO:teuthology.orchestra.run.smithi136.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 02:27 /home/ubuntu/cephtest 2024-04-26T02:27:20.156 INFO:teuthology.orchestra.run.smithi142.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 02:27 /home/ubuntu/cephtest 2024-04-26T02:27:20.173 INFO:teuthology.orchestra.run.smithi175.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 02:27 /home/ubuntu/cephtest 2024-04-26T02:27:20.175 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T02:27:20.189 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T02:27:20.218 INFO:teuthology.run:Summary data: description: rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} duration: 870.9715647697449 flavor: default owner: scheduled_yuriw@teuthology success: true 2024-04-26T02:27:20.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T02:27:20.318 INFO:teuthology.run:pass